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This  review  of  the  field  of  adaptive  training  (AT)  was  done  as  a 
part  of  a research  program  being  conducted  at  the  Aviation  Research 
Laboratory,  University  of  Illinois,  sponsored  by  the  Air  Force  Office 
of  Scientific  Research.  The  review  has  two  aims;  the  first  is  to 
assess  AT  as  a method  for  teaching  control  skills,  and  the  second  is 
to  establish  a conceptual  framework  that  will  allow  a detailed  analy- 
sis of  adaptive  manipulations  and  their  influence  on  skill  acquisition. 
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Adaptive  training  (AT)  is  a procedure  in  which  the  training 
schedule  is  Individualized  by  varying  task  difficulty  through  a graded 
series  of  steps  at  a rate  that  is  related  to  the  trainee's  speed  of 
learning.  A demanding  task  is  Initially  simplified  in  some  manner, 
and  the  trainee's  performance  is  monitored  so  that  task  difficulty  can 
be  gradually  Increased  as  he  develops  proficiency.  AT  is  based  on  the 
intuitively  appealing  assumption  that  a demanding  task  can  be  learned 
more  efficiently  if  it  is  presented  throughout  training  at  a level  of 
difficulty  that  is  optimally  matched  to  each  individual's  current 
ability  (Kelley,  1969  b). 

Individualized  training  schedules  can  be  justified  theoretically 
by  the  widespread  evidence  of  substantial  individual  differences  in 
ability  and  rates  of  learning  (Fleishman,  1967).  The  use  of  task 
simplification,  as  an  aid  to  learning  is  supported  by  the  view  among 
motor  skill  theorists,  that  complex  skills  are  composed  of  simple 
skills  (Fitts  and  Posner,  1967).  The  continuous  match  of  task  diffi- 
culty with  the  trainees  concurrent  level  of  skill  (Kelley,  1969  b), 
or  his  orderly  progress  through  a series  of  subtasks  that  are  graded 
in  complexity  (Gaines,  1967)  should  therefore  provide  a more  efficient 
training  experience  then  the  traditional  fixed  task  methods  (FT). 

From  a technical  viewpoint,  adaptive  procedures  are  becoming  more 
feasible  as  a result  of  the  considerable  advance  in  mini  and  micro 
computer  technology.  In  the  new  generation  of  computer-supported 
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systems,  computer  algorithms  that  process  Information  about  the 
operator's  behavior  can  directly  affect  the  nature  of  the  man-machine 
Interaction.  Thus  real  time  automated  applications  and  complex,  in- 
dividualized training  systems  are  becoming  more  economical  and  easier 
to  implement.  The  human  factors  community  recognized  the  potential 
value  of  computer  supported  systems  in  the  field  of  training  almost 
two  decades  ago  (Hudson,  1962).  Since  then  AT  has  been  investigated 
by  human  factor  specialists,  primarily  as  a means  of  facilitating  the 
acquisition  of  perceptual  motor  skills. 

The  bulk  of  AT  research  has  been  conducted  with  a dominant  applied 
orientation  and  with  a strong  aviation  bias.  Most  of  the  influential 
experiments  have  been  reported  in  establishment  publications  and  have 
rarely  been  published  in  scientific  journals.  The  dominant  applied 
orientation  has  produced  a substantial  body  of  data,  but  little  system- 
atic theorizing  about  the  process  of  skill  acquisition  under  the  adap- 
tive paradigm,  and  meager  discussion  about  the  relationship  of  those 
data  to  other  theoretical  conceptions  about  skill  acquisition.  As  a 
result,  the  work  on  AT  has  hitherto  failed  to  produce  a comprehensive 
review  of  research  or  a critical  evaluation  of  the  concept.  In  view 
of  the  fact  that  AT  systems  have  been  designed  into  some  aircraft 
simulators  (Caro,  1969),  presumably  at  some  added  expense,  a compre- 
hensive review  of  the  research  seems  overdue.  Our  review  represents 
an  effort  to  correct  this  deficiency  by  describing  the  basic  AT  para- 
digm, describing  and  evaluating  the  research,  and  establ  Ishing  a 
systematic  framework  to  guide  future  research. 
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In  describing  and  evaluating  the  research  we  have  Initially 
emphasized  the  pragmatic  implications  of  the  data  by  concentrating  on 
criteria  such  as  training  time,  transfer  of  training,  and  training 
costs,  as  is  consistent  with  the  tendency  demonstrated  in  published 
reports  of  research.  Nevertheless  the  experimental  data.  In  addition 
to  reflecting  on  the  training  effectiveness  of  adaptive  techniques, 
could  inform  us  about  the  process  of  skill  acqulstion.  A better  under- 
standing of  this  process,  whether  gained  from  AT  or  other  research,  is 
likely  to  contribute  to  improved  methods  of  skill  training.  The  review 
addresses  this  aspect  in  part  by  drawing  on  AT  and  other  motor  skill 
theory  and  data  to  determine  the  influence  of  various  features  of  the 
adaptive  paradigm  on  the  developing  motor  skill.  Thus  our  review  has 
two  alms:  the  first  is  to  assess  AT  as  a method  for  teaching  control 
skills,  and  the  second  is  to  establish  a conceptual  framt^work  that 
will  allow  a detailed  analysis  of  adaptive  manipulations  and  their  In- 
fluence on  skill  acquisition. 


FEATURES  OF  THE  ADAPTIVE  TRAINING  PARADIGM 


Adaptive  training  incorporates  a closed  loop  system  in  which  task 
difficulty  is  automatically  adjusted  in  relation  to  some  index  of  stu- 
dent performance.  The  adaptive  variable  is  the  task  feature  that  is 
adjusted  to  change  the  difficulty,  and  its  value  reflc^cts  the  trainee's 
current  performance  level.  A computer  algorithm  determines  tiie  adap- 
tive variable's  relationship  to  student  performance  so  that,  as  tiie 
trainee  Improves,  task  difficulty  Increases  to  maintain  the  index  of 
performance  within  predetermined  limits.  The  amount  of  learning  is 
operationally  defined  by  the  change  in  the  adaptive  variable.  The  condl 
tlons  of  training  are  operationally  defined  in  the  computer  algorithm 
which  specifies  the  nature  and  range  of  the  adaptive  variable,  tiie 
limits  of  the  performance  index,  the  period  over  which  performance  is 
averaged  to  provide  an  index  for  adjusting  the  task  difficulty,  and  the 
number  and  size  of  steps  in  difficulty. 

All  of  the  AT  experiments  to  be  reviewed  examined  the  acquisition 

c£ 

of  tracking  skills.  Tracking  behavior  has  been  extensively  investigated 
both  in  human  factors  laboratories  and  in  operational  situations.  Com- 
prehensive discussions  of  tracking  behavior  by  Adams  (1961),  Frost 
(1972),  Pew  (1974),  Poulton  (1974),  and  Sheridan  and  Ferrel  (1974)  are 
available.  The  schematic  diagram  of  a typical  tracking  task  in  figure  1 

shows  the  important  features  of  operational  and  synthetic  lahoratorv 
tracking  systems.  In  any  tracking  task  the  operator  must  fol low  a 
representation  of  a forcing  function  by  manipulating  a control  mechanism 


-6- 


The  control  mechanism  generates  an  output  signal  that  affects  the  be- 
havior of  the  system,  as  can  a random  disturbance  applied  directly 
to  the  system.  The  difference  between  the  system  output  and  the  forcing 
function  is  the , tracking ‘error  which  is,  for  operational  systems,  the 
discrepancy  between  the  actual  system  track  and  the  track  defined  by 
the  forcing  function,  and  for  synthetic  systems,  the  discrepancy  be- 
tween a controlled  cursor  that  represents  system  output  and  a target 
cursor  that  represents  the  forcing  function.  Although  AT  seems  rele- 
vant to  many  skilled  behaviors,  the  exclusive  emphasis  on  ‘tracking 
is  consistent  with  a predominant  Interest,  among  human  factor  special- 
ists, in  vehicular  coatrol  behavior. 

The  general  experimental  paradigm  for  comparing  adaptive  and  non- 
adaptive  methods  Includes  a control  group'  and  one  or  more  experimental 
groups.  The  control  subjects  experience  a non-adaptive  schedule  in 
which  they  practice  a criterion  task  throughout  training.  The  experi- 
mental subjects  first  practice  a relatively  simple  task  which  adapts 
towards  the  more  demanding  criterion  task  as  the  subjects  become  more 
skilled.  In  some  experimental  designs,  control  and  experimental 
subjects  transfer  to  a fixed  task  on  which  their  skill  is  assessed. 
Forcing  function  parameters,  system  characterlst 'cs , and  display 
characteristics  have  been  used  as  adaptive  variables.  The  effective- 
ness of  AT  has  been  judged  on  the  basis  of  indices  such  as  amount  of 
learning  in  a given  time,  skill  retention  over  an  extended  period, 
the  time  taken  to  learn  specified  skills,  and  transfer  of  skill  to 
similar  tasks.  From  the  results  of  the  experiments  following  this 


paradigm  many  experimenters  have  concluded  that  adaptive  training  is 
superior  to  fixed  training  (Caro,  1969;  Hudson,  1962,  1964;  Kelley, 
1969  b;  Lowes,  Ellis,  Norman  and  Matheny,  1968;  Norman,  1973).  A 
following  section  of  this  review  will  evaluate  the  AT  research  in 
order  to  assess  whether  confidence  in  the  effectiveness  of  AT  is  well 
founded . 

In  discussing  the  research.  It  has  been  necessary  to  reconi  ile 
the  different  terms  that  have  been  used  for  similar  adaptive  manipu- 
lations. Where  confusion  might  arise  the  terminology  used  by  Frost 
(1972)  and  Wickens  (1976)  has  been  accepted  because  it  is  svslematic 
and  Is  consistent  with  general  usage. 

Adaptive  manipulations  can  be  usefully  classified  as  perceptual, 
response,  or  feedback  variables.  Perceptual  manipulations  are  those 
resulting  from  changes  In  forcing  function  or  disturbance  inputs. 

Any  transformations  on  the  forcing  function  or  disturbance  inputs  will 
be  paralleled  by  similar  transformations  in  the  displayed  input.  An 
operator  who  Is  performing  efficiently  can  maintain  his  performance 
In  the  face  of  such  input  variations  by  applying  the  transformation 
perceived  In  the  displayed  information  to  his  own  control  betiavior. 
Response  manipulations  are  changes  in  system  dynamics.  Although  tlie 
required  transformations  between  old  and  new  control  behavior  are  un- 
ambiguously defined  by  the  changes  In  system  dynamics  tliey  are,  in 
contrast  to  those  resulting  from  forcing  function  or  disturbance  mani- 
pulations, not  directly  represented  In  the  display.  In  particular, 
similar  patterns  of  displayed  information  will  require  quite  different 
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response  patterns.  For  feedback  variables,  inputs  and  system  dynamics 
are  unchanged,  and  variations  in  the  quality  of  the  displayed  information 
are  used  to  adjust  task  difficulty. 

Response  Variables 

(1)  System  order  refers  to  the  transformation  between  control  dis- 
placement and  the  subsequent  displacement  of  the  controlled 
cursor.  A zero  order  (position)  system  is  one  in  which  a step 
control  displacement  is  transformed  into  a step  displacement 
at  system  output.  In  a first  order  (velocity)  system,  a 
similar  control  displacement  will  change  system  output  at  a 
constant  rate,  and  in  a second  order  (acceleration)  system, 
at  a constant  acceleration.  A third  order  system  that  con- 
stantly accelerates  (jerks)  the  sytem  output  in  response  to  a 
step  control  displacement,  is  the  highest  order  that  has  been 
used  in  AT.  Human  operators  find  tracking  more  difficult  as 
the  order  of  the  system  is  raised. 

System  order  can  be  changed  in  discrete  steps,  or  can  be 
varied  continuously  by  changing  the  ratio  of  higher  to  lower 
order  components.  It  has  been  adapted  in  six  experiments 
(Briggs,  1961;  Crooks,  1973;  Gopher,  Wllllgos,  Williges  and 
Damos,  1975;  Hudson,  1962,  1964;  Norman,  Lowes  and  Matheny, 
1972).  Manipulations  of  svstem  order  are  often  referred  to  as 
either  aiding  or  quickening.  The  Important  technical  distinc- 
tion between  quickening  ami  aiding,,  a^;  applied  |o  opi-ra  t Iona  I 
systems,  becomes  trivial  when  applied  to  synthoti<  systi-ms. 

A synthetic  system  is  termed  as  a aided  If  displayed  error 
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is  recorded,  but  as  quickened  IE  system  error  is  recorded 
(Norman  , 1972).  As  these  two  indices  of  error  are 

almost  certainly  highly  correlated  in  a synthetic  system,  aid- 
ing and  quickening  will  be  considered  in  the  discussion  of 
system  order. 

(2)  System  lag  is  measured  by  the  delav  of  a perceptible  system 
response  to  control  inputs.  Tracking  becomes  more  difficult 
as  lag  Increases  (Poulton,  197A).  A decrease  in  difficulty 

with  increasing  lag,  observed  by  Rockway  (1954)  has  been  explain- 
ed by  Poulton  (1974)  as  a range  affect.  Lag  has  been  adapted 
in  two  experiments  (Norman,  1973;  Norman  £t  al . , 1972),  hut  on 
both  occasions,  only  after  Initial  increases  in  task  difficulty 
had  been  achieved  by  adapting  gain.  This  procedure  was  suggested 
by  Matheny  and  Norman  (1968)  who  observed  that  short  lags  facili- 
tate skill  acquisition  and  that  task  difficulty  is  directly  pro- 
portional to  gain.  They  recommended  an  adaptive  manipulation 
that  initially  maintained  lag  at  some  small  value  while  task 
difficulty  was  Increased  by  increasing  gain  to  its  criterion 
value.  After  that  had  been  accomplished,  lag  could  be  Increased 
towards  its  criterion  value  to  further  Increase  task  difficulty. 

(3)  System  gain  is  defined  as  the  ratio  of  displacement  in  system 
output  to  control  displacement.  The  relationship  of  gain  to 
difficulty  is  non-monotonlc  in  that  both  high  and  low  gain 
systems  can  be  more  difficult  to  use  than  medium  gain  systems. 
High  gain  systems  require  fine  adlustments,  while  performance 
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wlth  low  gain  systems  can  be  limited  by  the  maximum  force  or 
displacement  the  operator  can  achieve.  Oaln  has  been  adapted 
in  four  experiments  (Gopher  ^ , 1975;  Hudson,  1964;  Norman, 

1973;  Norman  » 1972),  and  in  all  of  them,  difficulty  has 

been  Increased  by  Increasing  gain.  Two  of  the  gain  manipulations 
(Norman,  1973;  Norman  ^ , 1972)  have  been  made  in  conjunction 

with  manipulations  in  system  lag. 

(4)  System  stability  describes  the  tendency  of  a system  to  achieve 
or  regain  equilibrium.  A system  is  stable  if  a small  temporary 
input  causes  only  a temporary  change  in  output.  The  property 
of  stability  (or  instability)  is  a consequence  of  the  presence 
of  a feedback  loop  - with  positive  feedback  systems  tending  to 
be  more  unstable  then  negative  feedback  systems.  Unstable 
systems  are  difficult  to  control,  and  normally  yield  poor  track- 
ing performance  (Wlckens,  1976).  This  variable  has  been  adapt- 
ed in  two  experiments  (Hudson,  1964;  Bancroft  and  Duva,  1969). 

(5)  Damping  ratio  refers  to  the  attenuation  of  a second  order 
system's  response  to  its  resonant  frequencies.  High  damping 
ratios  produce  a sluggish  system,  and  low  damping  ratios  pro- 
duce an  unstable  system,  both  of  which  are  difficult  to  track. 
Gaines  (1967),  who  reduced  damping  ratio  from  an  in*^*  rmediate 

to  a low  value  to  increase  task  difficulty,  is  the  only  Investi- 
gator to  adapt  this  variable. 
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Perceptual  Variables 

(1)  Forcing  function  amplitude  refers  to  the  ampliti’de  of  the  random 
or  random  appearing  disturbance  app'ied  at  thi  system  input. 
Increases  In  this  variable  increase  any  or  all  of  displacement, 
velocity,  and  acceleration  of  the  target,  and  thus  increase 
tracking  difficulty.  It  has  been  adapted  in  five  experiments 
(Gaines,  1967;  Kelley,  1966;  Lowes  ^ al_. , 1968;  Norman  ^ al . , 
1972;  Wood,  1969). 

(2)  Forcing  function  bandwidth  refers  to  the  range  between  the 
lower  and  the  upper  cut-off  frequencies  contained  In  the  random 
appearing  disturbance  applied  at  the  system  input.  Increases 
In  this  variable  Increase  tracking  difficulty.  It  has  been 
adapted  In  two  experiments  (Gopher  ei^  al- , 1975;  Williges  and 
Willlges,  1976). 

Feedback  Variables 

(1)  Intrinsic  Information  about  the  effects  of  responses  can  bo 
supplemented  with  artificial  cues  that  are  more  Informative. 

Such  augmenting  cues  can  simplify  a control  task  (Armstrong, 

1970  b;  Elsele,  Willlges,  and  Roscoe,  1977;  Smith,  Pence,  Queen 
and  Wulfeck,  1974)  and  can  therefore  define  a dimension  of  diffi- 
culty. Augmenting  cues  that  are  programmed  to  be  available  only 
when  control  errors  exceed  a certain  criterion  are  Inherently 
adaptive  In  that,  as  the  sublect  improves,  hi*  obtains  loss 


assistance  from  them.  Several  studies  (Gilson  and  Venlola,  1976; 
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Gordon  and  Gottlieb,  1967;  Smith,  ej^  aJL- . Williams  and  Briggs, 
1962)  have  tested  augmented  feedback  that  is  Inherently  adap- 
tive. 

In  order  to  judge  the  efficiency  of  AT,  it  is  necessary  to  estab- 
lish relevant  and  comparable  criteria  for  the  several  experimental  design 
variations  that  have  been  used.  The  simplest  design  is  one  in  which 
subjects  learn  a task  by  practicing  it  in  an  adaptive  or  a fixed  mode. 
Training  efficiency  is  assessed  by  comparing  performance  levels  after  a 
pre-determined  period  of  training  or  by  comparing  amounts  of  training 
needed  for  groups  to  achieve  a performance  exit  criterion. 

In  the  more  common  transfer  of  training  design  subjects  generally 
transfer  to  a fixed  task  after  experience  with  either  an  adaptive  or  a 
fixed  pre-transfer  task.  This  design  is  analogous  to  the  situation  in 
which  operators  learn  in  a simulator  that  permits  adaptive  manipula- 
tions, and  then  transfer  to  the  operational  system  in  which  adaptive 
manipulations  are  not  feasible.  For  experiments  in  which  pre-transfer 
training  is  equal  for  all  groups,  training  efficiency  can  be  assessed 
by  examining  performance  levels  after  a set  amount  of  experience  witii 
the  transfer  task,  or  by  comparing  trials  to  crlterloh  on  the  transfer 
task.  Data  from  an  alternate  design  in  which  subjects  practice  the 
pre-transfer  task  to  exit  criterion  produce  results  that  are  difficult 
to  Interpret  because  amounts  of  pre-transfer  training  Invariably  differ 
between  groups:  amount  and  conditions  of  pre-transfer  training  ;iro 
therefore  confounded.  It  Is  possible  however,  t«)  unconfoiinil  these  two 
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RESEARCH 


Although  this  review  draws  only  from  the  literature  on  adaptive 
training,  the  similarity  between  AT  and  the  better  established  pro- 
grammed Instruction  technique  was  recognized.  In  fact  the  principles 
of  AT  are  so  similar  to  those  of  programmed  Instruction  that  there  is 
no  apparent  useful  distinction  between  the  two  methods  (Roscoe,  1974). 
The  distinction  that  AT  Is  specific  to  perceptual  and  motor  skills 
while  programmed  instruction  Is  specific  to  cognitive  skills  (Wood, 
in  McGrath  & Harris,  1971),  does  not  conform  to  common  usage.  Pro- 
grammed Instruction  has  been  used  to  teach  perceptual  skills  (Swets, 
Mlllman,  Fletcher  and  Green,  1962;  Moore  and  Goldlamond,  1964)  and 
AT  has  been  used  to  teach  cognitive  skills  (Walter,  Rivers,  King  and 
Hansen,  1970).  The  distinction  therefore  seems  artificial  and  is 
undesirable  because  it  could  discourage  investigators  preferring  either 
term  from  taking  account  of  relevant  theory  and  research  generated  by 
Investigators  preferring  the  alternate  term.  Nevertheless,  a search 
of  the  programmed  Instruction  literature  failed  to  reveal  any  relevant 
motor  skill  research.  Thus  only  experiments  from  the  literature  on 
AT  are  Included  in  the  review. 

The  AT  studies  using  response  and  perceptual  variables  have  been 
grouped  together  In  the  discussion  of  research  because  some  of  the 
studies  manipulated  both  types  of  variables.  It  was  not  possible  to 
further  subgroup  these  studies  In  terms  of  common  experimental  charac- 
teristics. In  lieu  of  a more  appropriate  classification,  we  first 


-15- 


present  the  early  studies  In  chronological  order.  These  studies, 
which  were  undertaken  In  various  laboratories,  established  the  research 
Interest  In  AT.  Since  1969  the  research  Involving  response  and  per- 
ceptual manipulations  has  been  centered  In  two  groups:  Norman  and 
his  associates,  and  the  Aviation  Research  Laboratorv  at  the  University 
of  Illinois.  The  work  from  each  of  these  groups  Is  presented  as  a 
separate  body  of  research.  Work  with  feedback  variables  is  described 
after  the  section  describing  the  tests  of  response  and  perceptt  al 
manipulations . 

Response  and  Perceptual  Variables 

An  Investigation  of  tracking  skills  by  Briggs  fl961)  provided 
some  impetus  for  AT  research.  Procedures  developed  In  that  experiment 
and  the  results  obtained  Influenced  the  design  and  direction  of  later 
experiments.  In  Briggs'  experiment,  groups  of  subjects  who  learned 
a one-dimensional  second-order  tracking  task  by  first  practicing  a 
zero-order  and  then  a first-order  task,  were  compared  to  a control 
group  that  practiced  only  the  second-order  task.  The  experimental 
groups  transferred  to  a higher-order  task  when  they  reduced  their 
tracking  error  to  a specified  value.  Briggs  compared  the  error 
scores  of  the  control  and  experimental  groups  on  successive  trials, 
starting  at  each  group's  first  trial  on  the  second-order  task.  There 
were  no  long  term  differences  between  groups  although  experimental 
groups  sln)wed  an  early  bill  lempurary  sii(»<t  li>r  I C y nvcr  (In-  imiirul 
group.  Briggs  concluded  that  experience  with  the  lower-order  tasks 
had  facilitated  the  acquisition  of  the  second-order  task. 
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The  benefit  of  experience  with  a lower-order  task  was  slight.  The 
advantage  shown  by  the  experimental  groups  over  the  control  group  dis- 
appeared after  eight  30-second  trials.  Furthermore,  tne  experimental 
groups  were  given  at  least  ten  30-second  practice  trials  more  than  the 
control  group  at  each  point  of  comparison.  A relevant  test  of  AT  would 
compare  the  groups  when  they  had  experienced  equal  amounts  of  tracking 
practice.  Such  comparison  shows  that  the  initial  advantage  lay  with  the 
control  group.  Nevertheless,  a subsequent  discussion  of  these  data 
(Hudson,  1964)  has  erroneously  established  this  experiment  as  one  that 
demonstrates  an  advantage  for  AT. 

Hudson  (1962,  1964)  has  reported  two  Investigations  of  AT.  In  the 
first  study  he  compared  the  performance  of  two  adaptively  trained  groups 
to  a non-adaptively  trained  control  group.  The  experimental  groups 
practiced  a two-dimensional  compensatory  tracking  task  In  which  diffi- 
culty was  adapted  by  varying  the  percentage  of  first,  second,  and  third 
order  components.  The  time  constant,  defined  for  the  adaptive  tasks  as  the 
interval  over  which  tracking  error  was  Integrated,  differed  for  the  two 
experimental  groups.  The  control  group  practiced  a fixed  third-order  version 
of  the  same  tracking  task.  All  groups  were  allowed  nine  20-mlnute  train- 
ing sessions.  After  every  training  session,  each  group  was  tested  for 
five  minutes  on  the  fixed  third-order  task  that  the  control  group  had 
practiced.  The  experimental  group  with  the  longest  time  constant  exhibited 
lower  error  scores  during  the  test  sessions  than  either  of  the  other  two 
groups.  From  these  data,  Hudson  (1962)  concluded  that  some  adaptive/ 
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manlpulat Ions  are  more  efficient  than  the  traditional  flx«d  difficulty 
manipulations. 

The  conclusions  to  be  drawn  from  these  data  are  weakened  by  doubts 
about  the  experimental  method.  The  tracking  system  was  so  unstable  that 
the  moving  cursor  could  disappear  from  the  screen  if  tlie  subject  lost 
control  of  It.  When  this  occurred  the  experimenter  would  reset  the 
cursor  for  the  subject  to  continue  tracking.  Hudson  (1962)  did  not 
reoort  how  long  the  cursor  would  remain  off  the  screen,  nor  whether  the 
periods  during  which  the  subject  waited  for  its  return  were  a part  of 
the  20  minute  practice.  Control  subjects  who  practiced  the  most  diffi- 
cult task  would  presumably  have  lost  control  more  frequently  during 
training  than  experimental  subjects.  If  out  of  control  time  was  included 


in  the  practice  time,  control  subjects  may  have  had  sufficiently  less 
experience  at  tracking  to  account  for  the  performance  difference  between 
the  control  group  and  the  best  experimental  group.  Furthermore,  Gopher 
and  Wlckens  (1975)  have  suggested  that  the  discontinuities  associated 


with  the  disappearance  of  the  cursor  during  loss  of  control  can  disrupt 
tracking  performance.  Either  or  both  of  these  factors  would  explain  the 
performance  advantage  shown  by  the  best  adaptive  group. 

In  a similarly  designed  experiment  Hudson  (196A)  used  the  same 
apparatus  to  compare  six  adaptively  trained  groups  with  one  non-adaptlvelv 
trained  group.  The  experimental  groups  practiced  a tracking  task  In 
which  either  system  order,  gain,  or  stability  was  adapted  either  auto- 


matically or  was  changed  manually  by  the  experimenter.  The  control  group 
practiced  a third-order  tracking  task.  After  a pre-determlned  training 
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period,  all  subjects  were  tested  on  the  third-order  task  that  had  been 
used  for  training  the  control  group. 

Performance  during  test  trials  was  related  to  the  difficulty  of  the 
training  task,  where  difficulty  was  a function  of  the  number  of  times 
the  subject  lost  control  of  the  tracking  system  during  the  training 
period.  The  groups  that  experienced  the  medium  difficulty  training  task 
performed  best.  Some  of  the  differences  were  statlstl'’al ly  reliable. 
Although  Hudson  (1964)  again  seems  to  have  demonstrated  that  some  adap- 
tive manipulations  are  more  efficient  than  non-adaptlve  manipulations, 
the  confounding  effects  of  frequent  control  losses  detract  from  the  value 
of  the  result.  Thus  Hudson's  (1962,  1964)  research  has  not  provided  the 
substantial  support  for  the  application  of  AT  that  it  might,  at  a pre- 
liminary reading,  appear  to. 

The  next  experiment  to  be  discussed  was  reported  by  Kelley  (1966) 
who  has  been  a leading  advocate  for  AT  (Kelley,  1969  b;  McGrath  and 
Harris,  1971).  Amplitude  of  the  forcing  function  was  chosen  as  the 
adaptive  variable.  In  this  experiment,  two  subjects  were  alternately 
given  adaptive  and  non-adaptive  trials  on  a two-dimensional,  second- 
order  tracking  task,  so  that  it  was  not  possible  to  compare  adaptive  and 
non-adaptive  training  at  any  stage.  Kelley  recognized  that  the  experi- 
ment was  limited  in  this  regard: 

"These  data  say  nothing  about  the  effectiveness 
of  adaptive  training  compared  with  fixed  train- 
ing." (Kelley,  in  McGrath  and  Harris,  1971, 
p.  10) 

He  nevertheless  used  this  experiment  to  support  Ills  coni  ithun-e  in  t he 
value  of  adaptive  training  (Kelley,  1969  h).  The  data  demonstrated  a 
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llnear  increase  In  performance  for  adaptive  trials  and  a curvilinear 
increase  for  non-adaptive  trials.  Because  the  subiects  alternated  be- 
tween adaptive  and  fixed  trials  the  comparison  is  merely  one  of  two 
methods  of  measuring  the  same  level  of  proficiency.  Kellev  (1969  b) 
apparently  assumes  that  learning  is  a linear  process  and  a measure  that 
exhibits  a linear  increase  is  therefore  more  appropriate.  However  both 
types  of  measures  could  conceivably  be  useful  in  different  circumstances. 

The  strength  of  Kelley's  adaptive  measure  of  performar.ee  lies  in  its 
demonstrated  reduced  variability  in  comparison  to  the  conventional 
measure  (Kelley,  1969a).  The  potential  of  the  adaptive  measure  to 
reliably  discriminate  small  performance  differences  could  be  useful  in 
many  training  and  testing  applications.  Nevertheless,  this  argument  has 
little  to  do  with  the  evaluation  of  adaptive  training  and  Kelley's  experi- 
ment has  not  demonstrated  any  training  advantages  for  the  method. 

The  first  clear  empirical  support  for  AT  was  obtained  by  (laities 
(1967)  from  an  experiment  in  which  subjects  learned  a third-order  track- 
ing task.  The  moving  cursor  was  controlled  with  a dual  push-button 
system.  The  subject  could  jerk  the  moving  cursor  to  the  right  by  press- 
ing one  button  and  jerk  it  to  the  left  by  pressing  the  other.  The 
system  was  unusual  in  that  the  directional  effects  of  both  buttons 
reversed  after  each  control  movement.  During  the  training  phase,  control 
subjects  practiced  either  a fixed,  difficult  task  or  a fixed,  easy  task. 

Adaptive  subjects  practiced  a task  in  which  the  damping  ratio  and  tlie 
amplitude  of  the  forcing  function  were  adjusted  to  vary  difficulty. 

Control  and  adaptive  subjects  were  then  tested  witli  a series  of  tasks  tliat  ’ 

Included  the  difficult  and  easy  tasks  used  to  train  the  controi  groups.  ^ 

i 
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The  adaptive  groups  exhibited  substantially  lower  error  scores  than 
the  fixed-task  groups  throughout  the  test  phase.  It  is  particularly 
relevant  to  this  review  that  the  adaptively  trained  groups  were  more 
skilled  on  the  fixed,  difficult  task  during  the  test  phase  tiian  were 
the  groups  that  had  trained  with  that  task.  This  experiment  clearly 
supports  the  AT  principle  that  learning  can  be  more  efficient  if  trainees 
are  allowed  to  learn  a difficult  task  bv  first  practicing  a graded  series 
of  simpler  versions  of  the  task.  Nevertheless  the  generality  of  this 
finding  is  in  doubt.  The  skills  required  for  the  push  button  controller 
used  by  Gaines  are  probably  very  different  from  those  required  for  the 
stick  or  wheel  controllers  found  in  other  AT  research  and  In  most  vehicles. 
Push  button  control  seems  to  emphasize  cognitive  skills  in  cotitrast  to 
motor  skills.  On  the  other  hand,  wheel  and  stick  controllers  require 
series  of  responses  that  approximate  complex  patterns  of  continuous  move- 
ment. The  magnitude,  duration,  and  direction  of  control  forces  must  be 
precise  and  must  be  integrated  into  an  appropriate  sequence.  Although 
Gaines'  data  are  encouraging,  similar  findings  from  experiments  that 
examine  skills  more  typical  of  operational  control  tasks  are  needed  to 
support  AT. 

In  a simple  comparison  of  adaptive  and  fixed  training  Wood  (1969) 
trained  sublects  on  a two-dimensional,  second-order  tracking  task. 

Amplitude  of  the  forcing  function,  which  was  selected  as  the  adaptive 
variable,  was  adjusted  so  that  the  experimental  group  maintained  a 
constant  RMS  error.  A control  group  was  trained  after  tin*  adapt  ivi* 
group,  and  the  difficulty  of  their  task  was  Increased  In  five  discrete 


steps  over  the  five  training  sessions.  Tlie  five  levels  were  obtained 
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from  the  median  forcing  function  amplitude  experienced  in  each  of  tlie 
adaptive  group's  five  sessions.  Wood  therefore  provided  similar  train- 
ing experiences  for  both  groups.  In  the  transfer  task  subiects  were 
tested  with  five  levels  of  forcing  function  amplitude.  The  non-adaptlvely 
trained  group  was  superior  to  the  adaptively  trained  group  at  all  trans- 
fer conditions. 

Although  Wood  (1969)  concluded,  from  these  data,  that  AT  was  less 
effective  than  fixed  training  (FT),  Kelley  (McGrath  and  Harris,  1971) 
claimed  that  Wood's  control  group  had  experienced  discrete  adaptive 
training  so  that  Wood  had  really  compared  two  adaptive  schedules.  Tn 
support  of  Kelley's  claim,  it  could  be  argued  that  the  groups  had  been 
randomly  selected  and  were  theoretically  equivalent.  The  control  group 
might  therefore  be  considered  as  a discretely  adapted  group  where  the 
rate  of  adaptation  was  based  on  the  performance  of  a similar  group. 
Nevertheless  adaptation  on  the  basis  of  group  performance  is  not  generally 
accepted  in  AT  methodology.  Kelley  (1969b)  has  stressed  that  one  of  the 
strengths  of  AT  is  that  task  difficulty  adapts  to  the  individual's 
ability  by  maintaining  his  error  rate  within  optimal  limits.  Wood's 
experiment  seems  to  be  a fair  test  of  AT,  and  it  is  one  that  has  demon- 
strated that  non-adaptlve  methods  can  be  more  effective. 

An  experiment  by  Bancroft  and  Duva  (1969)  examined  the  effects  of 
the  error  limit  that  was  used  to  control  the  adaptive  logic.  Tliese 
experimenters  proposed  that  subjects  who  had  to  track  within  .smaller 
error  limits  before  they  proceeded  to  the  next  step  in  the  adaptive 
schedule,  would  learn  more  or  less  efficlentiv  Ih.ni  suh)t‘<'ls  whose 
progress  was  controlled  by  larger  error  limits.  A control  group  was 
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included  so  that  AT  could  be  compared  with  FT.  Four  groups  of  subjects 
were  trained  on  a two  dimensional,  third-order,  compensatory  tracking 
task.  System  stability  was  adapted  through  six  levels  of  difficulty 
In  the  three  adaptive  conditions.  Adaptive  subjects  graduated  to  a 
higher  level  of  difficulty  when  their  Integrated  error  over  4 thirtv- 
second  trials  was  within  the  error  limit  specified  for  their  adaptive 
condition.  The  three  adaptive  groups  differed  only  In  regard  to  the 
error  limit  that  controlled  their  progress  through  the  adaptive  schedule. 
The  control  group  practiced  only  the  most  difficult  version  of  the  task. 
All  subjects  trained  for  270  thirty-second  trials  and  transferred  to 
the  most  difficult  version  of  the  task  for  20  thirty-second  trials. 

No  statistically  reliable  differences  were  found  for  tracking  error 
or  for  number  of  control  losses,  either  In  the  training  data  or  in  the 
transfer  data.  Therefore  the  experiment  failed  to  show  any  strong  support 
for  AT  and  did  not  effectively  discriminate  the  effects  of  the  variable 
error  limits.  Nevertheless  Bancroft  and  Duva  (1969)  suggested  that  the 
trends  In  the  data  favored  the  adaptive  schedules,  and  did  demonstrate 
the  differential  effectiveness  of  the  three  error  limits.  In  some  circum- 
stances their  conclusions  from  statistically  unreliable  data  might  be 
considered  as  tentative  support  for  AT.  It  could  be  argued  that  subjects 
were  trained  for  so  long  that  real  experimental  effects  may  have  been 
masked  because  all  subjects  approached  maximum  performance. 

Observation  of  the  training  data  supports  this  content I»>n.  The 
three  experimental  groups  graduated  to  the  m<iHt  difficult  task  with  an 
average  of  more  than  100  practice  trials  remaining,  and  appeared  to 
achieve  stable  performance  with  an  average  of  at  least  60  practice 
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trlals  remaining.  That  something  was  wrong  Is  clearly  shown  by  the 
failure  of  the  training  data  to  demonstrate  statistically  reliable  per- 
formance differences  between  conditions  that  varied  In  average  level  of 
difficulty.  The  trends  In  the  training  data  were  in  the  expected  direc- 
tion and  similar  trends  observed  in  the  transfer  data  might  also  reflect 
real  differences.  Nevertheless,  their  probable  cause  is  debatable.  Data 
supplied  by  Bancroft  and  Duva  show  that  subjects  In  the  fixed  group  lost 
control  of  the  system  more  frequently  during  training  than  did  subjects 
In  the  adaptive  groups.  Furthermore,  the  poorer  adaptive  groups  lost 
control  during  training  more  often  than  the  better  adaptive  groups.  The 
loss  of  control  problem  has  already  been  discussed  in  the  analysis  of 
Hudson's  work  (1962,  1964).  To  summarize  that  discussion,  the  time  taken 
for  the  apparatus  to  reset  after  loss  of  control  may  reduce  effective 
training  time  and  the  discontinuities  associated  with  loss  of  control 
might  disrupt  tracking  performance.  These  data  do  not  provide  even  tenta- 
tive support  for  AT. 

In  the  first  of  a series  of  AT  experiments  by  Norman  and  his  assoc- 
iates, subjects  were  taught  to  maintain  constant  apparent  altitude  in  an 
aircraft  simulator  (Lowes  al.- » 1968).  Forcing  function  amplitude  was 
chosen  as  the  adaptive  variable.  A control  group  and  an  adaptive  grotip 
were  trained  with  an  equal  number  of  trials  blocked  over  five  sessions. 
Forcing  function  amplitude  was  fixed  at  a low  value  for  the  control 
group's  first  training  block,  and  was  successively  Incremented  for 
the  subsequent  training  blocks.  The  forcing  function  amplitude  for  the 
adaptive  group  was  allowed  to  vary  between  the  lowest  and  the  highest 
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values  used  in  the  experiment.  The  forcing  function  amplitude  €‘xperlenced 
by  an  adapted  subject  'it  any  given  time  depended  on  his  own  current  con- 
trol performance. 

After  they  had  completed  the  five  training  blocks,  control  and  adapt- 
ed subjects  were  tested  with  the  intermediate  amnlitude  of  forcing  func- 
tion that  had  been  used  in  the  control  group's  third  training  block.  The 
test  block  error  scores  of  the  adaptive  group  were  reliably  lower  than 
those  of  the  control  group.  Although  Lowes  e_t  al.  concluded  from  these 
data  that  AT  is  superior  to  FT,  an  alternative  and  more  plausible  explana- 
tion is  possible.  The  average  forcing  function  amplitude  assumed  during 
the  adaptive  group's  training  trials,  by  virtue  of  the  adaptive  logic, 
approximated  the  value  used  in  the  test  blocks.  Thus  the  adaptive  sub- 
jects may  have  performed  the  transfer  task  more  efficiently  than  the 
control  subjects  merely  because  their  training  experience  more  closely 
approximated  the  test  conditions.  This  alternative  explanation  does  not 
permit  this  experiment  to  stand  as  a worthwhile  test  of  AT. 

To  follow  up  this  work  Noman,  Lowes  and  "^atheny  (1972)  used  a trans- 
fer of  training  design  to  compare  the  performances  of  six  experimental 
and  two  control  groups  of  subjects  in  maintaining  level  pitch  in  an  air- 
craft simulator.  Three  adaptive  variables  were  considered:  forcing 
function  amplitude,  system  order,  and  a combination  of  system  gain  and 
lag  in  which  gain  was  adjusted  during  early  training  and  lag  adjusted 
during  later  training.  Six  experimental  groupr  were  formed  so  that  each 
variable  could  be  adapted  either  automat  lea  1 1 v fir  could  be  atl  lusted  hv 
the  experimenter  while  the  'ther  vari.ihles  vie''e  ma  I nl  .-i  Ined  al  (heir 
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criterlon  values.  The  adaptive  variable  In  the  automatic  Rroups  varied 
continuously  until  It  reached  Its  criterion  value,  which  was  used  as  the 
exit  criterion  for  the  subjects  training  under  that  condition. 

The  adaptive  variables  were  adjusted  twice  In  the  manual  conditions, 
and  the  second  adjustment  was  to  the  criterion  value.  Subjects  exited 
from  the  pre-transfer  task  when  they  could  perform  the  most  difficult  ver- 
sion of  the  task  within  a specified  error  tolerance.  The  six  experimental 
groups  transferred  to  a task  that  differed  from  the  final  form  of  the  pre- 
transfer task  only  in  that  all  variables  remained  fixed  at  values  differ- 
ent from  those  used  in  the  pre-transfer  task.  Two  control  groups  were 
included  In  the  experiment.  The  first  was  treated  similarly  to  the 
experimental  groups,  except  that  all  variables  remained  fixed  at  their 
criterion  values  throughout  training.  The  second  group  practiced  onlv 
the  transfer  task. 

Norman  e_t  al^.  examined  the  number  of  trials  taken  to  achieve  the 
exit  criterion  on  the  pre-transfer  task.  These  data  showed  that  the 
group  trained  with  manually  adapting  system  order  learned  more  slowlv 
than  any  other  group,  but  did  not  reveal  any  other  differences  between 
adaptive  and  non-adaptlve  groups.  The  total  training  and  transfer 
trials  Index  appeared  to  follow  closely  the  trend  of  the  training  trial 
Index,  but  It  was  not  statistically  tested.  The  authors  relied  on  a 
transfer  trials  Index  to  test  their  adaptive  techniques.  A comparison 
of  adaptive  groups  with  the  control  group  that  had  received  no  pre- 
transfer training,  showed  a statistically  reliable  advantage  for  all 
adaptive  conditions  over  the  non-adaptlve  condition.  However  this  was 
not  a reasotiabJt’  test  of  AT  because,  as  noted  earllr>r  In  this  revic'w. 
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amount  and  tvpe  of  training  are  confounded  in  transfer  data  for  which 
pre-transfer  training  is  not  equalized.  Notwithstanding  the  claim  of 
Norman  £t  , this  experiment  has  also  failed  to  demonstrate  anv  adv.intaci- 
of  AT. 

Norman  (1973)  used  a similar  experimental  design  to  extend  the 
research  reported  by  Norman  £l.  (1  972).  During  tlie  training  pliase  of 
this  experiment  subjects  learned  to  control  the  pitch  and  roll  of  a 
low  performance  aircraft  simulator  as  it  was  buffeted  by  simul.tted  gust 
turbulence.  When  subjects  could  control  pitch  and  roll  wittiin  pre- 
speclfied  error  limits,  they  transferred  to  a simulation  of  a high 
performance  aircraft  that  was  also  buffeted  by  gust  turbulence,  and 
practiced  that  to  the  same  criterion.  The  adaptive  variable  was  the 
same  combination  of  system  gain  and  lag  used  in  the  previou.s  experiment. 

It  was  automatically  Increased  towards  its  criterion  value  as  liie 
subject's  control  performance  improved.  Two  Independent  variables  were 
tested.  Five  different  performance  measurement  intervals  were  used  to 
define  one  independent  variable.  The  other  was  defined  by  two  variations 
in  high  frequency  components  of  the  forcing  function.  Two  control  groups 
were  used;  one  practiced  only  the  high  performance  simulation  to  criter- 
ion and  the  other  practiced  the  fixed  version  of  the  low  performance 
simulation  to  criterion  before  transferring  to  the  high  perf''rmHnce 
simulation . 

Subjects  were  allowed  only  twenty  trials  in  which  to  achieve  cri- 
terion performance  on  the  pre-transfer  task  and  to  achieve  a similar 
standard  on  the  transfer  task.  Tliose  .subjects  who  were  unable  to 


satisfy  these  requirements  within  the  twenty  trial  limit  were  classified 
as  failures  and  dismissed  from  the  experiment.  Norman  continued  to  test 
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new  subjects  until  six  had  satisfied  the  performance  requirements  in 
each  control  and  experimental  group. 

The  experiment  was  designed  to  conform  to  a common  pilot  training 
paradigm  In  which  a trainee  pilot  learns  control  skills  in  a simulator 
and  then  transfers  to  the  parent  system.  In  this  experiment  the  parent 
system  was  also  simulated.  Norman  developed  a cost-of-training  index 
In  which  the  time  spent  on  the  parent  system  simulator  was  assumed  to 
be  five  times  as  expensive  as  time  spent  on  the  training  simulator. 

The  cost  of  training  each  group's  failed  subjects  was  added  to  the  cost 
of  training  the  six  passing  subjects  in  that  group.  A comparison  of 
the  experimental  and  control  groups  on  the  basis  of  the  cost  index 
showed  that  some  adaptive  groups  were  less  expensive  to  train  than  the 
control  groups.  The  differences  were  statistically  reliable. 

The  validity  of  Norman's  cost  of  training  index  is  suspect.  The 
statistical  reliability  of  the  results  was  largely  due  to  the  procedure 
of  falling  subjects  who  did  not  complete  the  experiment  within  20  trials. 
Those  groups  with  many  failed  subjects  Invariably  received  a high  rating 
on  the  cost  of  training  index.  The  number  of  failures  per  group,  which 
ranged  from  zero  to  five,  showed  no  systematic  trend.  The  apparent 
randomness  of  the  distribution  of  fallues  and  the  substantial  Influence 
that  failures  had  on  cost  of  training  seem  to  Invalidate  the  cost  index 
as  a basis  for  comparing  groups.  In  addition,  the  seemingly  arbitrary 
costing  of  parent  system  time  as  five  times  more  expensive  than  train- 
ing system  time  can  be  questioned.  These  nncerialnl  les  ahonl  (he  desig.ii 
and  analysis  of  the  experiment  are  serious  enough  to  preclude  it  as  a 


suitable  test  of  AT. 
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In  the  first  of  a series  of  experiments  from  the  Aviation  Research 
Laboratory  at  the  University  of  Illinois,  Crooks  (1973)  tested  four 
adaptive  methods  and  one  non-adaptlve  method  of  teaching  a two  dimensional 
tracking  task.  The  ratio  of  second-order  to  first- order  components  in 
the  system  was  used  as  the  adaptive  variable.  The  second-order  compo- 
nent for  the  four  adaptive  groups  was  initially  set  at  30%,  and  subjects 
practiced  the  task  until  it  had  reached  the  exit  criterion  of  80%.  The 
adaptive  logic  for  three  of  the  adaptive  groups  Increased  the  second- 
order  component  If  the  subjects  tracked  within  a prespecified  error 
limit  and  decreased  It  if  they  tracked  outside  of  that  limit.  The  three 
groups  differed  In  that  the  prespecified  error  limits  remained  constant 
throughout  training  for  one  group.  Increased  as  the  subject  improved 
in  another  group,  and  decreased  as  the  subject  improved  in  the  third 
group.  The  prespecified  error  limits  for  the  fourth  adaptive  group  re- 
mained constant  throughout  training.  This  group  differed  from  the  other 
adaptive  groups  in  that  the  second-order  component  of  the  task  could 
not  decrease  If  subjects  tracked  outside  the  error  limit.  The  two 
changing  error  limits  approached  the  fixed  error  limits  used  by  the 
other  groups  so  that,  at  exit  criterion,  subjects  from  the  four  groups 
were  performing  an  Identical  task.  Control  subjects  In  the  non-adaptlve 
group  practiced  the  task  with  a fixed  80%  second-order  component  and 
exited  from  It  when  thev  reduced  their  error  to  the  final  value  xised 
In  the  .'uLipt  Ivc*  regimes. 

Number  of  trials  to  achieve  the  training  task  exit  criterion  was 
established  as  the  primary  dependent  variable.  '.Vhen  tested  against 
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this  dependent  variable,  the  non-adaptlve  group  was  as  successful  as 
the  adaptive  group  that  had  not  been  permitted  any  decreases  in  the 
acceleration  component  when  they  exceeded  the  error  limit.  The  three 
remaining  adaptive  groups  required  more  trials  to  achieve  exit  criterion. 
Two  other  dependent  variables,  one  a transfer  task  and  the  other  a re- 
tention task,  did  not  reveal  any  differences  among  the  five  groups. 

Not  only  did  this  experiment  fall  to  demonstrate  any  advantage  of  AT, 
but  also  appeared  to  demonstrate  that  some  adaptive  manipulations  could 
retard  skill  acquisition. 

A subsequent  experiment  from  the  same  laboratory  used  a two  dimen- 
sional tracking  task  to  examine  three  adaptive  variables  (Copher  , 

1975).  Frequency  of  forcing  function,  system  gain,  and  system  order 
were  Increased  adaptively  by  themselves.  In  pairs  and  together  in  seven 
different  training  conditions.  In  one  additional  training  condition 
the  three  variables  remained  fixed.  For  training  conditions  In  which 
they  did  not  adapt,  variables  remained  fixed  at  the  average  adaptive 
values  achieved  in  a preliminary  study  by  five  flight-naive  subjects 
in  their  fourth  flve-mlnute  period  on  a fully  adapting  task.  Subjects 
in  the  main  study  were  trained  over  five  three-minute  sessions.  Tliey 
were  transferred  to  eight  minutes  of  continuous  tracking  on  a task  In 
which  the  three  variables  remained  fixed  over  two  minute  periods  but 
changed  to  new  fixed  values  at  the  end  of  each  two  minute  period. 

Subjects  returned  approximately  one  week  after  their  first  testing 
date  to  complete  a retention  task  that  was  similar  to  the  transfer  task. 
The  mean  RMS  error  for  the  transfer  task  and  for  the  retention  task  did 
not  reveal  any  reliable  differences  between  groups. 
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An  additional  dependent  variable  suggested  by  Gopher  et  (1Q7S) 

was  designed  to  test  the  operator's  adaptability  to  a changing  situation. 
In  support  of  this  dependent  variable,  Gopher  e^  argued  that  vehi( le 
operators  must  be  able  to  cope  with  changes  in  system  dynamics  and  in 
disturbance  characteristics.  Adaptive  techniques  that  change  these 
variables  throughout  training  may  better  prepare  the  operator  for  vari- 
ations in  control  demand.  To  test  this  idea.  Gopher  ej^  aj.  examined  llie 
RMS  error  from  the  transfer  task  before  and  after  the  changes  to  differ- 
ent fixed  values.  The  differences  between  the  mean  RMS  error  over  the 
last  15  seconds  of  a two-minute  period  and  the  mean  RMS  error  of  the 
first  15  seconds  of  the  following  two-minute  period  were  averaged  for 
each  subject  over  the  three  relevant  change  points.  These  data  showj-d 
that  frequency  and  gain  adapted  subjects  performed  better  during  transi- 
tion periods  than  subjects  who  were  not  frequency  or  gain  adapted  during 
training.  A similar  analysis  of  the  retention  task  did  not  reveal  any 
reliable  differences.  Nevertheless,  the  transfer  data  supports  the 
hypothesis  that  some  adaptive  training  manipulations  can  help  an  operator 
learn  to  cope  with  changes  in  the  external  disturbances  and  in  system 
dynamics. 

Willlges  and  Wllliges  (1976)  extended  the  previous  study  by  investi- 
gating manual  and  automatic  adaptations  of  forcing  functions  bandwidtii. 

In  a two  dimensional  pursuit  tracking  task  the  adaptive  variable  was 
adjusted  either  automatically  or  by  the  subject  with  a dual  buttt)n  key- 
board ad  laeeiil  to  the  coiilrol  stick.  I•■(>r  I In-  rouirol  condiliiiu  | In- 
task  was  fixed  at  the  maximum  bandwidth  used  in  the  adaptive  schedules. 
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All  subjects  practiced  to  a bandwidth  and  error  criterion  and  then 
transferred  to  a similar  fixed  task. 

Transfer  performance  was  best  for  the  manually  adapted  group  and 
worst  for  the  control  group.  T'he  difference  between  the  two  was  statis- 
tically reliable.  The  transfer  performance  of  the  automatically  adapted 
group  lay  between  those  of  the  other  two  groups  but  was  not  reliably 
different  from  either.  Although  amount  and  type  of  training  were  con- 
founded in  this  experiment,  poorer  group  transfer  performance  corresponded 
to  longer  pre-transfer  training,  so  that  the  superior  performance  of  the 
manually  adapted  group  cannot  be  attributed  to  more  extensive  pre-transfer 
practice.  The  data  therefore  demonstrate  ar  advantage  for  the  bandwidth 
adaptation. 

Feedback  Variables 

Smith  e_^  (1974)  developed  an  adaptive  paradigm  based  on  displayed 

Information  about  the  probable  future  course  of  the  controlled  cursor  in 
a one  dimensional  tracking  system.  Displays  that  present  this  tvpe  of 
Information  have  been  widely  Investigated  under  the  rubric  of  predictor 
displays,  and  have  been  shown  to  substantially  decrease  the  difficulty 
of  complex  control  tasks  (Kelley,  1968;  Kennedy,  Wulfeck,  Prosin  and 
Burger,  1974).  The  predictive  Information  was  computed  by  a fast-time 
model  of  the  system  dynamics  on  the  basis  of  current  system  state  and 

r 

l certain  assumptions  about  the  operator's  behavior.  The  experiment  hy 

f Smith  ct  a^.  (1974)  Is  the  first  to  examine  a predictor  display  as  a 

learning  rather  than  a performance  aid. 
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The  tracking  task  simulated  the  descent  of  a jet  training  aircraft 
along  a glide  slope.  It  was  performed  in  an  aircraft  simulator  In  which 
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the  standard  flight  Instruments  had  been  replaced  with  a side  looking 
cathode  ray  display  that  depicted  the  desired  glide  slope,  an  error 
tolerance  envelope,  a controlled  cursor  representing  the  aircraft,  and 
a line  that  showed  the  predicted  track  of  the  controlled  cursor.  Each 
trial  started  with  the  simulated  aircraft  on  final  approach  In  level 
flight.  Approximately  eight  seconds  later  the  controlled  cursor  reached 
the  glldeslope,  and  the  subject  then  tracked  the  glideslope  to  its 
point  of  Intersection  with  the  runway.  Each  trial  lasted  approximately 
sixty  seconds. 

Ten  groups  of  subjects  were  tested.  One  was  a control  group  that 
received  no  predictor  Information,  and  the  other  nine  were  experimental 
groups  that  trained  under  various  conditions  of  predictor  Information. 

The  experimental  schedules  were  made  adaptive  by  presenting  the  pre- 
dictor Information  only  when  a subject's  performance  fell  below  a 
prespecified  standard  so  that,  during  earlv  training  the  predictor 
information  was  available  for  most  of  the  time,  but  was  presented  for 
decreasing  periods  of  time  as  the  subject  Improved.  The  nine  experi- 
mental conditions  were  established  by  completely  crossing  two  variables. 

One  variable  was  the  criterion  for  presenting  the  predictor  Information, 
which  would  automatically  appear  only  If  the  error  was  predicted  to  he 
outside  of  the  tolerance  envelope  In  zero,  five,  or  ten  seconds.  The 
other  variable  was  defined  bj’  the  duration  of  prediction,  which  could  be 
five,  ten  or  twenty  seconds.  After  practicing  a prespecified  number  of  trials, 
subjects  transferred  to  a test  condition  that  was  IrU-nlical  lo  I lu'  control 
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tralnlng  condition.  Integrated  altitude  error  on  the  transfer  task  was 
used  as  the  primary  dependent  variable. 

Some  of  the  experimental  groups  demonstrated  superior  transfer  per- 
formance. Long  predictor  spans  and  early  anticipation  of  error  allowed 
the  best  transfer  performance,  while  conditions  with  short  predictor 
spans  and  those  in  which  the  predictive  information  appeared  only  when 
the  tolerance  envelope  had  been  exceeded,  were  generally  no  bettor  than 
the  control  condition.  Unfortunately  it  Is  not  possible  to  determine 
whether  the  adaptive  feature  of  the  schedules  contributed  to  the  superior 
performance  of  the  better  experimental  groups.  Predictor  information, 
presented  In  a non-adaptlve  mode  during  the  training  phase,  might  have 
demonstrated  similar  advantages.  An  extra  control  group  In  which  pre- 
dictor information  was  available  throughout  training,  regardless  of 
the  subject's  performance,  could  have  resolved  this  Issue,  and  is 
recommended  for  future  studies  of  this  type.  Nevertheless,  the  experi- 
ment does  tentatively  support  the  application  of  feedback  adaptations 
in  training. 

A flight  experiment  by  Ollson  and  Ventola  (197b)  has  demonstrated 
the  value  of  adaptive  augmented  feedback  for  aircraft  landing  instruction. 
These  Investigators  mounted  a tactual  display  on  the  control  yoke  of  a 
light  airplane  to  give  student  pilots  pitch  error  information  during  six 
takeoff  and  landing  trials  with  the  display,  and  then  another  six  with- 
out It.  A second  group  flew  their  first  six  trials  without  the  display 
and  their  second  six,  with  it.  The  tactual  display  clearly  aided  l.ind- 
Ing  performance  while  It  was  active.  In  addition,  a comparison  of  the 
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two  groups'  performances  on  the  trials  In  which  the  tactual  disnlay 
was  not  used,  indicated  that  practice  with  the  display  aided  later  land- 
ing performance  without  it. 

Adaptive  supplementary  feedback  has  also  been  tested,  under  the 
rubric  of  augmented  feedback,  with  standard  pursuit  rotor  and  other 
tracking  tasks.  Gordon  and  Gottlieb  (1967),  and  Gordon  (1968)  used  a 
pursuit  rotor  to  examine  the  effects  of  supplementary  visual  feedback 
that  was  available  during  learning  trials  only  when  their  experimental 
subjects  were  off- target.  The  experimental  group's  subsequent  perform- 
ance on  a similar  transfer  task  with  no  supplementary  feedback  was 
reliably  superior  to  that  of  a control  group  that  had  practiced  with- 
out supplementary  cues.  Williams  and  Briggs  (1962)  obtained  a similar 
result  in  a contr.ol  knob  tracking  equipment  that  tested  off-target  aural 
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' DISCUSSION  OF  RESFjmCH  AND  OF  THE  ADAPTIVE  TRAINING  CONCEPT 
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Adaptive  training  research  has  provided  very  little  support,  in 
comparison  to  the  magnitude  of  the  research  effort,  for  the  application 
of  perceptual  and  response  adaptations  to  applied  training  situations. 
The  only  unequivocal  and  statistically  reliable  data  to  demonstrate 
their  effectiveness  was  obtained  with  an  atvnical  control  task  (Gaines, 
1967).  Several  of  the  experiments  that  apparently  support  AT  principles 
have  methodological  problems  that  are  critical  enough  to  discount  the 
conclusions  drawn  from  them.  In  general,  the  research  related  to  per- 
ceptual and  response  adaptations  has  produced  little  conclusive  evidence 
for  or  against  AT.  In  contrast,  the  meager  data  on  feedback  adaptations 
show  a consistent  and  statistically  reliable  advantage  for  AT  (Gilson  and 
Ventola,  1976;  Smith  e_^  al- > 1974).  Further  support  for  augmented  feetl- 
back  adaptations  is  available  from  the  more  theoretically  oriented 
augmented -feedback  research  (Gordon,  1968;  Gordon  and  Gottlieb,  1967; 
Williams  and  Briggs,  1962). 

The  AT  literature  has  failed  to  answer  some  basic  and  critical 
questions.  In  particular,  is  the  concept  well-founded  and  worth  further 
effort?  If  it  is,  wliat  manipulations  are  likely  to  be  successful? 
Research  to  this  date  has  had  a strongly  applied  emphasis  that  has 
encouraged  investigators  to  concentrate  on  aspects  of  AT  that  are  mf)St 
appropriate  to  their  Immediate  concerns.  As  commendable  as  this  may 
appear,  it  has  not  established  the  theoretical  or  conceptual  basis  that 
is  essential  for  orderly  development  of  AT.  The  following  discussion 
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ratlonalizes  the  AT  data  with  other  psychological  theory  and  data  In  order 
to  construct  a sound  conceptual  basis  for  the  research. 

The  Idea  that  an  adaptive  algorithm  should  provide  an  optimum 
schedule  for  skill  acquisition  has  been  based  on  the  evidence  that  demon- 
strates wide  individual  differences  in  skill  acquisition  and  on  the  belief 
that  complex  skills  are  comprised  of  simple  skills.  There  are  ImweviT 
other  principles  within  the  motor  skill  literature  that  bear  on  the  AT 
model.  Although  these  principles  gain  theoretical  and  empirical  support 
from  a variety  of  sources,  they  all  have  Implications  for  Important  features 
of  AT. 

The  first  principle  to  be  noted  is  that  skilled  behavior  can  develop 
only  in  the  presence  of  consistent  and  lawful  stimulus-response  relation- 
ships. Contemporary  motor  skill  theories  that  are  Incompatible  in  some 
respects  (Adams,  1971;  Pew,  1974;  Schmidt,  1975)  have,  as  one  point  of 
agreement,  the  need  for  consistent  stimulus-response  relationships. 
Inconsistent  stimulus-response  relationships  would  presumably  Inhibit 
development  of  the  perceptual  trace  (Adams,  1971),  or  would  Interfere 
with  development  and  selection  of  the  appropriate  motor  program  (Pew,  1974) 
or  schema  (Schmidt,  1975).  Within  the  AT  context  procedures  that  force 
trainees  constantly  to  develop  new  strategies  or  responses  to  unchanging 
stimulus  demands  or  that  abruptly  change  stimulus  demands  with(nit  consequent 
changes  In  response  requirements  are  unlikely  to  be  effective. 

A related  principle  Is  that  skills  learned  in  one  situation  ran  he 
transferred,  with  partial  performance  loss,  to  similar  situations.  Hold- 
ing (1976)  has  outlined  the  transfer  relationships  that  can  be  expect€>d 
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between  perceptual-motor  tasks  that  vary  along  stimiil>;s  or  response 
dimensions.  Within  AT,  the  task  to  be  adapted  sliould  be  cl)anged  in  a 
way  that  enhances  positive  transfer  from  Its  easy  to  its  more  difficult 
versions.  The  choice  of  adaptive  variable  is  important  because  not  all 
manipulations  of  difficulty  are  equally  likely  to  enhance  skill  acquisi- 
tion. Positive  transfer  from  easy  to  difficult  v£;rsions  of  the  task  is 
undoubtedly  essential  for  the  adaptive  schedule  to  be  effective. 

A third  Important  principle  is  that  repetition  of  the  stimulus- 
response  relationship  is  necessary  to  establish  all  but  the  most  trivial 
behaviors.  From  the  principle  of  transfer,  the  repeated  behaviors  need 
not  be  Identical,  but  must  be  similar  In  Important  respects.  Schedules 
that  do  not  allow  sufficient  repetition,  or  force  repetition  o^  un- 
representative responses,  are  unlikely  to  facilitate  skill  acquisition. 

The  fourth  principle  listed  here  Is  that  some  complex  tasks  can 
be  segmented  Into  several  simple  tasks.  This  principle  has  been  ex- 
ploited In  the  part-whole  training  paradigms  in  which  practice  with 
simple  segments  of  a task  have  facilitated  the  acquisition  of  the  whole 
task  (Adams,  1960;  Fitts  & Posner,  1967;  Welford,  1968).  Tills  procedure 
can  be  ineffective  If,  through  segmenting  the  task,  its  most  difficult 
aspects  are  lost,  or  If  the  segments  do  not  teach  skills  that  ran  be 
used  to  perform  the  whole  task.  In  addition,  some  tasks  are  not  suffi- 
ciently difficult  to  warrant  segmentation  Into  easier  components.  These 
observations  indicate  that  for  AT,  the  tasks  should  be  difficult  enough 
to  warrant  this  type  of  Intervention,  and  the  adaptive  variable  should 
be  chosen  so  that  when  the  trainee  practices  simple  versions  of  the 
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task,  he  will  learn  skills  that  he  will  use  when  performing  the  criterion 
version  of  the  task. 

The  final  principle  Is  related  to  the  feedback  that  the  trainee 
receives  about  his  behavior.  Armstrong  (1970a)  has  distinguished  motiva- 
tional and  guidance  feedback.  The  emphasis  that  some  contempor.iry  theories 
place  on  the  role  of  guidance  feedback  (Adams,  1971;  Schmidt,  1975)  is 
supported  by  the  research  of  Trowbridge  and  Cason  (1932)  and  of  McCuigan 
(1967)  which  indicates  that  more  precise  guidance  information  facilitates 
the  acquisition  of  a discrete  motor  skill.  Intrinsic  response-produced 
feedback  may  be  adequate  to  learn  and  perform  the  task,  or  supplementary 
feedback  such  as  error  Information  from  an  Instructor  may  be  needed. 
Nevertheless  feedback  of  an  appropriate  type  probably  Is  essential  for 
skill  acquisition. 

These  principles  are  to  some  extent  interrelated  and  to  list  tht^ 
all  Is  to  occasionally  restate  a point.  Nevertheless  each  has  been 
deemed  Important  in  several  motor  skill  contexts  and  together  they 
account  for  the  most  co'-mon  relationships  In  skill  acquisition.  As  a 
first  approximation  any  AT  procedure  that  violates  one  or  more  of  them 
is  unlikely  to  be  maximally  effective.  These  principles  are  used  in 
the  subsequent  discussion  ot  research  to  examine  the  potent ia  of  differ- 
ent adaptive  variables,  the  role  of  feedback,  parameters  of  the  adaptive 
logic,  and  criterion  task  difficulty.  Adaptive  manipulations  will  be 
discussed  again  under  the  headings  of  response,  perceptual,  and  feed- 
back variables.  Both  AT  and  transfer  of  training  data  are  used  to  assess 
the  potential  merit  of  various  adaptive  iminlpulatlons.  The  discussions 
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of  adaptive  logic  parameters  and  of  criterion  task  difficulty  will  be 
primarily  conceptual  because  there  Is  little  empirical  work  related  to 
these  Issues. 

Adaptive  Variables 

AT  researchers  have  been  primarily  concerned  with  optimizing  task 
difficulty  throughout  training.  They  have  generally  treated  difficulty 
as  a single  dimension  and  have  apparently  assumed  that  any  convenient 
manipulation  of  task  difficulty  will  be  satisfactory.  Difficulty  has 
been  extensively  investigated  as  an  Independent  variable,  but  reviews 
of  this  work  indicate  that  changes  in  the  several  variables  that  can 
be  used  to  manipulate  task  difficulty  have  dissimilar  effects  on  skill 
acquisition  (Day,  1956;  Holding,  1962).  Task  difficulty  is  more  appro- 
priately considered  as  a dependent  variable  that  Is  operationalized  by 
ordering  scores  on  some  measure  of  performance.  Instead  of  considering 
it  as  a single  dimension  under  the  questionable  assumption  that  it  has 
consistent  effects  on  skill  acquisition,  each  of  the  adaptive  variables 
that  can  Influence  task  difficulty  will  be  evaluated  separately. 

Although  response,  perceptual,  or  feedback  adaptations  almost 
certainly  have  different  effects  on  learning,  their  relative  merits  as 
adaptive  variables  have  rarely  been  discussed.  The  nature  of  the  criter- 
ion task  in  particular  seems  relevant  to  the  choice  of  adaptive  variable. 
For  example,  because  control  of  an  inherently  unstable  rotary  wing  air- 
craft during  hover  is  primarily  a motor  skill  ])roblem,  response  or  per- 
ceptual adaptations  that  change  response  difficulty  seem  to  be  the  most 
appropriate.  In  contrast,  landing  a fixed  wing  aircraft  In  poor  visibility 
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is  difficult  primarily  because  of  the  Imprecise  nature  of  the  visual 
cues,  so  that  a feedback  adaptation  seems  to  be  most  appropriate.  The 
recommended  adaptation  in  each  of  these  examples  is  preferred  because 
it  allows  the  task  to  be  varied  over  a greater  range  of  difficulty  than 
the  alternate  adaptations.  This  argument  indicates  that  the  choice  of 
response,  perceptual,  or  feedback  variables  should  be  based,  to  some 
extent  at  least,  on  the  nature  of  the  criterion  task. 

In  addition  to  neglecting  any  discussion  of  the  type  of  variable 
that  should  be  adapted,  AT  researchers  generally  have  failed  to  iustifv 
the  specific  variables  they  have  chosen.  In  particular  the  nature  of 
the  transfer  between  the  task  variations  defined  by  the  adapted  dlmen- 
sloits  has  been  ignored.  Fxjual  increments  in  difficulty  might  be  obtain- 
ed by  varying  any  single  variable,  or  any  combination  of  variables,  but 
different  manipulations  could  have  quite  different  effects  on  skill 
acquisition.  With  some  manipulations  practice  at  one  level  of  diffi- 
culty could  conceivably  interfere  with  performance  at  higher  levels. 

It  seems  reasonable  to  expect  that  an  adaptive  manipulation  will  facili- 
tate skill  acquisition  only  if  transfer  from  easy  to  difficult  task 
variations  is  both  positive  and  substantial. 

The  rationale  for  this  expectation  can  be  clarified  with  an  example 
of  a hypothetical  transfer  of  training  experiment.  The  fundamental  AT 
assumption  is  that  training  on  an  appropriate  easy  task  can  better  pre- 
pare an  operator  for  a difficult  criterion  task  than  can  equivalent 
training  on  I lu*  «-rilerlon  r.isk  lim*ir.  This  I'onld  hi*  losic'tl  In  .in 
experiment  in  which  subjects  transferred  to  the  criterion  task  .iIHt 
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some  training  on  the  easy  task.  A control  group  that  trained  tlirough- 
out  on  the  criterion  task  would  be  necessary  for  comparison.  That  the 
experimental  group's  pre-transfer  task  is  easier  than  the  criterion 
task  would  be  demonstrated  by  the  fact  that  their  performance  during 
the  pre-transfer  phase  is  better  than  the  control  group's  performance 
on  the  corresponding  criterion  task  trials.  Possible  data  trends  are 
shown  in  Figure  2,  and  in  particular,  two  alternative  trends  are  shown 
for  the  experimental  group's  transfer  data.  Although  both  of  the  experi- 
mental group's  transfer  trends  demonstrate  positive  transfer  in  that  the 
early  transfer  trials  reflect  better  performance  than  do  the  control 
group's  early  trials,  only  trend  B demonstrates  an  advantage  for  prior 
training  on  the  easy  task.  In  contrast,  data  that  follow  trend  A reveal 
that  trainees  learn  more  about  the  criterion  task  by  practicing  the 
criterion  task  than  by  practicing  the  easy  task. 

In  some  transfer  of  training  studies  transfer  has  taken  place 
along  a dimension  that  has  elsewhere  been  used,  or  might  be  used,  as  an 
adaptive  variable.  Tlie  data  from  these  transfer  experiments  seems  rele- 
vant to  a discussion  of  AT.  It  is  true  that  the  adaptive  and  transfer 
designs  differ  noticeably  in  that  adaptive  designs  employ  several  small 
"easy  to  difficult"  steps  while  transfer  designs  employ  only  one. 

Although  size  and  number  of  steps  could  well  be  critical  factors,  a 
variable's  influence  In  a multi-step  experiment  is  likely  to  correlate 
with  its  Influence  In  a one-step  experiment.  Furthermore,  the  compar- 
ability of  data  from  experiments  with  few  or  many  steps  has  heiu)  ncj-epl- 
ed , at  least  implicitly,  by  those  experimenters  who  were  Influenced  by 
Briggs'  (19bl)  two-step  experiment. 
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Figure  2,  Hypothetical  transfer  of  training  data.  Trends  A and  B 
represent  alternate  possible  transfer  trends  For  the 
experimental  group. 


-43- 


Thus  transfer  of  training  data  will  be  combined  with  the  previously 
discussed  AT  data  to  evaluate  the  potential  merit  of  some  adaptive  mani- 
pulations. Sufficient  data  are  available  from  transfer  and  adaptive 
studies  to  make  at  least  a preliminary  judgment  about  the  potential  of 
system  order,  gain  and  lag,  forcing  function,  and  augmented  feedback 
manipulations.  An  additional  variable  called  percentage  of  display 
pursultedness  has  never  been  used  as  an  adaptive  variable  but  will  be 
considered  because  It  is  relevant  to  tracking  behavior  and  because  it 
can  be  used  to  represent  a dimension  along  which  tracking  difficulty  can 
be  varied. 

Response  Variables 

System  order  has  emerged  as  the  most  popular  adaptive  variable,  hut 
transfer  data  indicate  that  it  is  unlikely  to  provide  an  effective  train- 
ing manipulation.  Lincoln  (1953)  showed  that  practice  on  a zero-order 
system  was  less  adequate  preparation  for  subsequent  tracking  on  a first- 
order  system  than  was  practice  with  the  first-order  system.  Briggs,  Fitts 
and  Bahrlck  (1958)  similarly  showed  that  practice  with  a first-order 
system  produced  poorer  performance  on  a second-order  system  than  did 
equal  practice  with  the  second-order  system.  Transfer  from  a combination 
zero,  first,  and  second-order  system  to  a pure  second-order  system  also 
failed  to  show  any  advantage  for  prior  training  on  the  lower-order  svstem 
(Holland  and  Henson,  1956). 

Experimental  comparisons  of  qulckc*ned  and  unqulrkenod  displays  have 
produced  similar  results  (Dooley  and  Newton,  1956;  C.oldstein,  1961).  Of  tbe 
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AT  experiments  in  which  system  order  has  been  adapted  (Briggs,  1961; 
Crooks,  1973;  Copher  £t^  al,.  , 1975;  Hudson,  1962,  1964;  Norman  e^t  a 1 . , 

1972)  only  the  two  by  Hudson  that  were  criticized  on  methodological 
grounds,  revealed  any  advantage  for  the  adaptive  manipulations.  Further- 
more, Crooks  (1973)  has  shown  that  order  manipulations  can  retard  skill 
acquisition:  an  observation  that  is  supported  by  unreliable  trends  in 
the  transfer  data  from  Gopher  eit  ad. , (1975).  System  order  therefore 
appears  to  be  an  inappropriate  choice  as  an  adaptive  variable. 

Transfer  of  training  data  from  Rockway,  F.rkstrand  and  Morgan  (1956) 
indicate  that  gain  is  unlikely  to  bo  a useful  adaptive  variable.  In  this 
experiment,  subjects  practiced  on  one  of  three  gain  conditions  and  trans- 
ferred to  the  highest  and  most  difficult  gain  condition.  There  were  no 
perceptible  differences  between  the  transfer  performances  of  the  three 
groups.  The  AT  data  are  also  not  very  encouraging.  Gopher  et  a_l_. , (1975) 
were  able  to  show  an  advantage  for  gain  with  their  exploratory  dependent 
variable,  but  unreliable  trends  in  their  overall  transfer  scores  indi- 
cated that  FT  was  better  than  AT  in  which  gain  was  manipulated. 

Because  system  lag  is  inherent  in  any  tracking  system,  has  a well 
defined  relationship  to  tracking  difficulty,  and  can  be  easily  manipulated, 
it  appears  to  be  a potentially  useful  adaptive  variable.  Tt  has  been 
tested  in  two  AT  experiments,  and  in  both  it  was  combined  with  a system 
gain  manipulation  (Norman,  1973;  Norman  et  al . , 1972).  Neither  of  those 
experiments  provided  acceptable  data.  However  a transfer  of  training 
experiment  by  Levine  (1953)  provided  some  relevant  data  that  discourages 
the  use  of  system  lag  as  an  adaptive  variable.  Transfer  performance  on 


-45- 


a no-lag  condition  for  a group  that  had  practiced  previou:ily  with  a lagged 
system  was  no  better  than  that  of  a group  that  had  remained  on  the  lagged 
system  throughout  the  experiment.  Nevertheless  these  data  must  also  be 
supplemented  with  results  from  other  experiments  before  firm  conclusions 
can  be  drawn  about  the  potential  value  of  lag  as  an  adaptive  variable. 

Theoretical  considerations  indicate  that  response  manipulations  are 
unsuitable  adaptive  variables.  As  defined  earlier,  response  manipula- 
tions are  those  in  which  the  operator  must  learn  to  generate  new  responses 
to  unchanging  stimulus  information.  Holding  (1976)  has  observed  that 
there  is  a high  probability  of  negative  transfer  in  this  type  of  situation. 
This  possibly  results  from  the  fact  that  it  violates  the  principle  of 
consistent  stimulus-response  relationships.  Although  response  variables 
can  be  used  to  change  task  difficulty,  this  type  of  manipulation  seems 
unsatisfactory  for  training  purposes. 

Perceptual  Variables 

Forcing  function  adaptations  have  been  popular,  but  the  supporting 
data  are  inconclusive.  The  successful  amplitude  manipulation  used  by 
Gaines  (1967b)  was  tested  with  an  unrepresentative  tracking  task.  The 
data  provided  by  Lowes  e^  (1969)  and  Norman  e^  al.  (1972)  are  suspect 
because  of  methodological  problems  with  those  experiments.  Gopher  et  al . 
(1975)  could  demonstrate  an  advantage  for  their  bandwidth  manipulation 
only  with  their  exploratory  dependent  variable  chosen  to  examine  perform- 
ance stability. 

In  contrast,  the  evidence  against  forcing  function  adaptations  Is 
Impressive.  Wood  (1968)  found  that  his  amplitude  manipulation 
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was  less  effective  than  his  non-adaptive  manipulation  and  r.opher 

et  al.  (1975)  obtained  a null  result  with  orthodox  transfer  and  retention 

measures  in  comparing  a bandwidth  adaptation  with  a control  condition. 

The  degree  of  transfer  between  frequency  and  amplitude  variations  in 
transfer  of  training  experiments  employing  a pursuit  rotor  (Ammons, 

Ammons  and  Morgan,  1954;  Lordahl  and  Archer,  1958),  was  insufficient  to 
encourage  either  frequency  or  amplitude  adaptations.  However  it  may 
be  unwise  to  rely  on  a null  result  or  on  pursuit  rotor  data.  Wood's 
result  is  noteworthy,  but  in  view  of  the  conflicting,  altliough  question- 
able data,  -judgment  of  forcing  function  adaptations  should  be  delayed 
until  more  extensive  data  are  available.  Further  transfer  studies 
employing  appropriate  tracking  apparatus  could  resolve  this  question. 

Perceptual  manipulations  theoreticallv  are  more  sound  than  response 
ni. ill  Ipu  lilt  ions  bee.iiifK'  they  p i I ve  I y c-xleiul  I lie  reperlolri-  ol  sliiniilus- 

retponse  relationships  rather  than  change  them.  Adaptive  training  with 
a perceptual  variable  is  analogous  to  the  type  of  part-whole  training 
that  can  sometimes  facilitate  acquisition  of  a complex  task  through 
prior  training  with  simple  components  of  the  task  (Adams,  1960;  Fitts 
and  Posner,  i967;  Wolford,  1968).  If  tlie  analogy  is  valid,  appropriate 
simple  elements  of  the  complex  task  that  can  be  properly  integrated  or 
sequenced  to  ensure  positive  transfer  between  various  difficulty  levels 
must  be  identified  to  establish  the  adaptive  schedule.  Althougli  theories 
of  skill  ar»pilsitlon  might  he  expected  to  Indicate  suitable  s«'gmentat  ions 
ol  the  coniptox  task  and,  llioi'oloro,  the  appropi  late  ailaptive  vai  lahle, 
contemporary  theories  seem  Inadequate  for  this  purpose.  The  selectl«>n 
of  an  appropriate  perceptual  manipulation  remains,  for  the  present  at 
a firedom  I nant  1 v empirical  problem. 
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Feedhack  Variables 

Augmented  error  Information  that  is  concurrent  with  the  response, 
that  tells  the  subject  when  he  Is  off-target,  and  that  guides  the  operator 
to  the  correct  behavior,  has  been  tested  twice  (Gilson  and  Ventola,  1976; 
Smith  al^. , 1974),  and  In  both  experiments  transfer  performance  was 
enhanced  by  the  adaptive  feedback  manipulation.  Augmented-f eedback 
studies  employing  concurrent,  off-target  feedback  also  support  the  use  of 
feedback  adaptations  (Gordon,  1968;  Gordon  and  Gottlieb,  1967;  V/illiams 
and  Briggs,  1962). 

Other  transfer-of-trainlng  studies  have  tested  concurrent,  augmented- 
feedback  that  Informs  the  subject  when  he  Is  on-target.  Some  of  these 
experiments  have  demonstrated  benefits  for  augmented-f eedback  (Gordon  and 
Gottlieb,  1967;  Karlin,  1965,  Karlin  and  Mortimer,  1963;  Klnkade,  1963; 
Seashore,  Underwood,  Houston  and  Berks,  1949;  Williams  and  Briggs,  1962) 
while  others  have  produced  null  results  (Archer,  Kent  and  Mote,  1956; 

Archer  and  Namlkas,  1958;  Bilodeau  and  Rosenquist,  1964;  Sheldon  and 
Bjorklund,  1966). 

The  greater  consistency  of  evidence  In  favor  of  the  off-target  mani- 
pulation may  have  resulted  from  the  fact  that  It  Is  Inherently  adaptive 
in  that,  as  the  subject  learns  the  skill,  the  augmented-f eedback  Is  pre- 
sented for  decreasing  periods  of  time.  Thus  transfer  to  a non-augmented 
feedback  condition  will,  for  a skilled  subject,  constitute  a less  sub- 
stantial task  change  than  If  on-target  Information  had  been  augmented  during 
acquisition.  As  positive  transfer  between  tasks  that  require  Identical 
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responses  is  related  to  slmllarltv  of  stimuli  (Holding,  lH7fi),  Ute  oif- 
target  manipulation  seems  to  be  the  most  appropriate. 

The  data  from  feedback  studies  are  sufflclentlv  encouraging  to 
warrant  further  research.  In  particular,  the  benefits  of  on  and  off- 
target  schedules,  various  types  and  parameters  of  command  and  predic- 
tor Indicators  (eg.  Roscoe,  Elsele  and  Bergman,  1975),  and  differing 
error  limits  should  be  examined. 

Percentage  of  display  pursultedness , a concept  introduced  by 
Briggs  and  Rockway  (1966)  , could  provide  another  useful  perceptual 
manipulation.  Although  tracking  displays  are  generally  classified  as 
pursuit  or  compensatory,  Briggs  and  Rockway  established  a display  that 
was  partially  pursuit  and  partially  compensatory.  Thus  a display  that 
is  25%  pursuit.  Is  also  75%  compensatory.  Pursuit  distil  ays  are  easier 
to  track  than  compensatory  displays  (Poulton,  1974)  so  that  display 
pursultedness  could  also  be  used  as  a dimension  of  difficulty  for 
control  tasks.  Although  this  variable  has  not  yet  been  manipulated 
In  any  AT  experiments.  It  could  be  used  to  teach  vehicular  control 
activities  that  are  Inherently  compensatory,  but  could  be  simulated 
as  pursuit  tasks.  Tracking  an  aircraft  along  the  extended  centerline 
of  a runway  In  the  presence  of  gustlng  crosswinds  Is  one  example  of 
a task  that  is  Inherently  compensatory,  but  could  be  represented  as 
a pursuit  task  in  an  aircraft  simulator. 

One  transfer  of  training  study  (Gordon,  1959)  supports  the  use 
of  percentage  of  display  pursultedness  as  an  adaptive  variable.  In 
tlial  ••xperlineni  , sublects  who  were*  Initially  tr.-ilned  on  a pursuit  task 


performed  better  on  a compensatory  task  than  subjects  who  had  trained 
throughout  on  the  compensatory  task.  There  is  however,  some  incon- 
sistency in  the  available  data.  A similar  experin.ent  by  Briggs  and 
Rockway  (1966)  revealed  no  performance  differences  on  a compensatory 
transfer  task  for  groups  trained  with  degrees  of  display  pursu i tcdness 
ranging  from  zero  to  10P%.  It  may  be  relevant  that  Cordon  used  a 
spring  loaded  control  while  Briggs  and  Rockw.ay  used  .a  qu.asi-isotonic 
control.  If  transfer  from  pursuit  to  compensatory  tasks  depends  on 
proprioceptive  cues  learned  in  the  pursuit  task,  the  system  used  by 
Briggs  and  Rockway  would  produce  less  transfer  than  the  one  used  by 
Gordon.  This  hypothesis  needs  to  be  resolved  empirically  as  a prelude 
to  investigation  of  display  pursultedness  as  an  adaptive  variable. 

The  feedback  variables  discussed  so  far  provide  the  operator  with 
information  that  is  concurrent  with  his  responses  and  enhances;  the  in- 
formation he  would  normally  receive  about  the  nature  of  his  control 
errors.  The  Importance  of  the  second  characteristic  is  supported  by 
contemporary  motor  skill  theories  that  strei.s  the  guidance  role  of 
Information  feedback  in  skill  acquisition  (Adams,  1971;  Schmidt,  1975). 
The  expectation  that  the  concurrency  of  feedback  is  important  is 
derived  from  discrete  motor  skill  learning  research  (Bilodeau,  1956; 
Boulter,  1964)  in  which  subjects  performed  some  activity  during  the 
delay  between  a response  and  Its  guidance  feedback.  In  Bllode.ni's 
experiment,  guidance  feedback  to  each  response  was  delayed  while  the 
subject  made  one  or  more  other  responses  to  wliich  feedback  was  also 
delayed  by  the  same  number  of  responses.  Execution  of  responses  in  the 


•» 


-50- 


feedback  delay  Interval  degraded  performance  In  the  acquisition  trials. 

Boulter's  experiment  showed  that  verbal  or  motor  activity  Inserted  in 
the  feedback  delay  Interval  could  degrade  performance  after  feedback 
was  withdrawn.  Altiiough  activity  in  the  feedback  delay  inli-rval  doi-s 
not  degrade  transfer  performance  after  extensive  learning  (Lavery,  1964; 

Lavery  and  Suddon,  1962),  it  does  seem  to  interfere  with  earlv  learning. 

Othei  experiments  (Bilodeau  and  Bilodeau,  1958;  Bilodeau  and  Ryan, 

1960;  Boulter,  1964;  Saltzman,  Kanfer,  and  Ori'enspoon,  1955)  have  not 
shown  anv  acquisition  or  transfer  effects  of  varying  an  unfilU-d  delay 
but  the  findings  of  Bilodeau  (1956)  and  Boulter  (1964),  that  activity 
during  the  feedback  delay  does  Interfere  with  acquisition  and  transfer, 
seems  more  relevant  to  continuous  tracking  behavior.  Continuous  skills 
would  similarly  suffer  from  Interference  ny  Intervening  ri‘sy>onsos  if 
feedback  was  delayed.  Augraented-f eedback  Is  likely  to  be  an  effective 
adaptive  variable,  and  the  potential  to  make  It  concurrent  with  the 
response  may  be  an  Important  advantage  that  automatic  feedback  systems 
have  over  human  Instructors. 

However  not  all  types  of  feedback  are  likely  to  be  equally  effec- 
tive. Although  many  research  workers  In  AT  have  assumed  that  the 
motivational  effects  of  feedback  are  critical  In  skill  acquisition 
(McCrath  and  Harris,  1971),  there  Is  little  evidence  to  support  this 
assumption.  Only  Norman  (1973)  has  tested  It  within  the  AT  research, 
lie  allowed  some  of  his  suhjects  to  monitor  a mi'ter  that  displayc'd  con- 

, I 

current  Information  about  their  performance.  This  group  learned  the  -i 

‘ .4 

tracking  task  more  quickly  than  a similarly  trained  group  that  was  r 

»• 
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denled  the  meter  Information.  Unfortunately  the  result  was  confounded 
by  sampling  biases.  The  feedback  group  contained  a substantial  number 
of  naval  recruits  while  the  non-feedback  group  consisted  only  of  college 
students.  The  effects  of  these  sampling  differences  is  unknown. 

Other  AT  experiments  In  which  motivational  feedback  was  augmented 
(Wood,  1969;  Crooks,  1973)  did  not  compare  feedback  to  no-feedhack  condi- 
tions. From  the  results  of  a transfer-of-tralnlng  experiment  Smode  (1958) 
has  argued  that  motivational  feedback  does  facilitate  the  acquisition  of 
tracking  skill.  However  Smode  used  concurrent,  on-target  feedback  that 
would  seemingly  have  helped  to  guide  the  subjects  to  the  desired  responses 
as  well  as  to  motivate  them.  The  effects  of  motivation  on  the  acquisition 
of  tracking  skill  have  been  difficult  to  demonstrate  (Bilodeau  and  Bilodeau 
1961).  Some  appropriate  motivation  undoubtedly  is  essential  to  activate 
behavior  and  to  focus  attention  on  the  task  but  Increments  in  motivation 
about  a certain  level  apparently  do  not  substantially  facilitate  learning 
(Hulse,  Deese,  and  Egeth,  1975). 

To  be  maxlmallv  effective  feedback  should  both  guide  the  subject's 
responses  and  be  concurrent  with  them.  This  type  of  feedback  could  be 
used  within  AT  either  as  an  adaptive  variable  or  as  a transfer  variable 
that  is  fixed  at  an  optimal  configuration  during  initial  training  in  con- 
junction with  a schedule  that  adapts  some  non-feedback  variable.  Both 
types  of  schedules  could  prove  to  have  a potent  Influence  on  skill 
acquisition. 

Parameters  of  the  Adaptive  Logic 

Adaptive  training  has  been  compared  clsewltere  to  luinuin  Instruction 
of  high-level  subjects  in  which  students  are  guided  through  sub-topics 
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of  graded  difficulty  (McGrath  and  Harris,  1971).  The  analogy  is  appro- 
priate in  that  the  human  instructor,  by  some  casual  or  forma]  process, 
will  determine  the  number  and  size  of  steps  in  difficulty,  and  will  in- 
fluence the  rate  at  which  the  student  makes  them.  The  stepping  rate  is 
influenced  by  the  acceptable  performance  standard  set  by  the  instructor 
and  by  the  intervals  separating  successive  assessments  of  student  per- 
formance. This  rate  will  tend  to  be  low  if  the  student's  performance 
must  improve  substantially  before  he  is  allowed  to  progress  or  if  the 
summaries  of  his  performance  that  determine  whether  he  will  be  allowed 
to  advance  or  not  are  separated  by  long  intervals.  The  parameter  that 
defines  size  and  number  of  steps  and  the  two  that  define  the  stepping 
rate  are  explicitly  programmed  into  the  adaptive  logic  as  the  step 
size,  the  performance  limits,  and  the  performance  measurement  interval. 

Although  the  analogy  between  human  and  automatic  adaptive  instruc- 
tion has  been  used  to  support  the  validity  of  AT  (Kelley,  1969b),  it  is 
considered  here  as  no  more  than  an  illustration.  Its  particular  value 
in  that  role  is  that  it  clarifies  the  questions  that  should  be  asked 
about  the  adaptive  logic.  What  are  the  optimal  size  and  number  of  in- 
crements in  difficulty?  How  frequently  should  the  trainee  be  assessed 
and  how  well  should  he  be  expected  to  perform  before  he  is  allowed  to 
advance?  Should  he  be  allowed  to  return  to  eisler  versions  of  the 
task  if  his  performance  deteriorates  below  some  minimum  standard? 
Although  tliese  questions  have  been  Inadequatelv  investigated,  t hev 
are  important  enough  for  their  implications  to  be  examined. 
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The  number  and  size  of  steps  in  difficulty  has  ranged  from  a few 
large  steps  (e.g.  Lowes  et^  al^.  , 1968)  to  many  small  steps  (e.g.  Crooks, 
1973).  Norman  ^ (1972)  compared  conditions  with  many  small  steps 

to  those  with  few  large  steps  by  comparing  automatic  and  manual  adapta- 
tions. A manual  group  with  adapting  system  order  did  not  perform  as 
well  as  the  relevant  automatic  group,  and  other  non-reliable  trends 
for  their  forcing  function  and  their  combination  gain/lag  adaptations 
favored  the  automatic  groups.  In  support  of  these  observations,  trans- 
fer theory  suggests  that  steps  above  a critical  size  are  not  optimal. 
Holding  (1976)  has  noted  the  high  probability  of  negative  transfer 
with  all  but  very  small  changes  in  response  requirements  where  the 
stimulus  is  essentially  unchanged.  In  addition  the  principles  he 
outlines  suggest  that  positive  transfer  will  be  small  if  perceptual 
and  feedback  variables  are  changed  substantially.  Thus  transfer 
theory  does  suggest  that  the  step  size  can  be  too  large,  but  does  not 
Indicate  its  critical  size  for  any  variable.  These  values  will  un- 
doubtedly have  to  be  determined  empirically. 

The  stepping  rate  is  Influenced  by  the  performance  limits  that 
determine  whether  the  trainee  will  advance  and  by  the  performance 
measurement  Interval.  By  an  earlier  stated  principle  that  repetition 
is  essential  to  establish  all  but  the  most  trivial  responses,  stepping 
rate  should  be  low  enough  for  the  trainee  to  repetitively  practice 
each  of  the  skill  segments  along  the  easy-to-difflcult  dimension. 
However  a very  low  stepping  rate  could  force  the  trainee  to  practice 
some  of  the  skill  segments  for  an  unnecessarily  long  time. 
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Unfortunately  It  is  difficult  to  translate  this  conceptual  argu- 
ment into  specific  values  for  the  adaptive  logic.  Empirical  tests  of 
the  variations  in  performance  limits  (Bancroft  and  Duva  1969;  Crooks, 
1973)  have  not  produced  reliable  differences  between  the  experimental 
conditions.  Presumably  a performance  standard  that  approximates  that 
required  in  the  operational  situation  will  be  advantageous  in  that 
it  is  more  likely  to  encourage  the  appropriate  response  habits  and 
strategies.  If  this  criterion  is  accepted  for  establishing  perform- 
ance standards,  the  freedom  to  establish  an  optimum  stepping  rate  lies 
in  varying  the  performance  measurement  interval.  Only  Norman  (1973) 
has  tested  this  parameter,  but  methodological  problems  with  his 
experiment  makes  his  data  difficult  to  Interpret.  At  present  there 
are  no  clear  principles  to  determine  the  optimal  stepping  rate  so  that, 
within  operational  AT  systems,  it  will  have  to  be  established  bv  trial 
and  error. 

The  final  question  related  to  the  adaptive  logic  is  whether  trainees 
whose  performance  temporarily  deteriorates  should  be  allowed  to  return 
to  easier  segments  of  the  adaptive  schedule.  There  seems  to  be  no 
theoretical  argument  that  bears  directly  on  this  issue.  One  empirical 
test  (Crooks,  1973)  has  shown  that  trainees  who  were  not  permitted  to 
return  to  easier  versions  of  the  task  learned  more  efflcently  than  a 
comparable  adaptive  group  tliat  was.  Note  however,  that  the  non-return- 
ing schedule  was  not  more  efficient  than  a nonadaptlve  schedule  and  the 
adaptive  variable  was  the  system  order  manipulation  that  has  been 
criticized  earlier  in  this  review.  Therefore  the  relevance  of  this 


result  Is  debatable. 
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Anv  or  ill  of  these  parameters  of  the  adaptive  logic  could  affect 
the  efficiency  of  AT.  Further  research  must  be  undertaken  to  establish 
optimal  values,  and  to  derive  principles  for  determining  them  in  ad- 
vance if  AT  procedures  are  to  approach  their  potential  effectiveness. 

Criterion  Task  Difficulty 

Adaptive  training  could  be  useful  for  two  distinct  applications. 

The  first  is  one  in  which  Che  criterion  task  can  be  learned  under  FT, 
but  the  use  of  AT  speeds  the  process.  This  is  consistent  with  the 
asstiraptlon  that  control  tasks  can  be  learned  more  efficiently  if  thev 
are  presented  at  an  optimum  level  of  difficulty  (Kelley,  1969b).  In 
an  alternate  application,  AT  could  enable  operators  to  learn  a control 
task  that  is  too  difficult  to  learn  under  FT. 

Gaines  (1967a)  has  suggested  that  some  tasks  can  be  so  far  beyond 
the  current  skill  of  the  trainee  that  even  extended  fixed  practice 
does  not  permit  him  to  improve.  This  might  happen  if  the  task  was  so 
difficult  that  the  operator  was  out  of  control  thr 'ughout  the  training 
period.  Practice  with  an  approprate  easier  task,  as  in  an  adaptive 
schedule,  might  help  the  trainee  develop  skills  that  would  transfer  to 
the  criterion  task,  thereby  bringing  it  within  the  trainee's  adaptive 
skill  range.  This  application  of  AT  would  allow  an  operator  to  achieve 
a level  of  proficiency  that  he  could  not  attain  under  FT,  while  the  first 
application  would  not  gain  any  jidvantage  over  FT  in  final  level  of 
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performance,  but  would  help  the  trainee  attain  that  level  more 
efficiently. 

The  effectiveness  of  AT  for  these  two  applications  should  be 
tested  with  slightly  different  experimental  designs.  To  show  that 
AT  Is  more  efficient  than  FT  for  achieving  a criterion  performance, 
subjects  should  be  trained  to  that  criterion  and  the  time  taken  to 
achieve  It  could  be  compared.  This  type  of  design  was  appropriate 
for  all  of  the  AT  experiments  that  have  been  reviewed  because  the 
experimental  tasks  could  be  learned  under  fixed  schedules.  However 
only  Crooks  (1973),  Norman  e^  aT_.  (1972),  and  Norman  (1973)  trained 
their  subjects  to  criterion.  Others  examined  training  or  transfer 
task  performance  after  a set  amount  of  training.  The  dangi r of  this 
approach  is  most  clearly  Illustrated  In  the  report  by  Bancroft  and 
Duva  (1969).  Subjects  In  that  experiment  practiced  for  so  long  that 
even  the  slowest  learning  groups  had  attained  maximum  performance  well 
before  the  end  of  the  training  trials.  Therefore  the  transfer  test 
could  not  have  been  expected  to  reveal  differences  due  to  training 
methods.  This  design  would  have  been  appropriate  If  a task  that  was 
too  difficult  to  learn  under  FT  had  been  used.  The  extended  training 
time  should  have  provided  ample  opportunity  for  the  subjects  to  Improve 
as  much  as  each  of  the  fixed  and  adaptive  schedules  would  allow. 
Dliferences  between  adapted  and  fixed  groups  at  the  end  of  training 
or  on  the  transfer  task  would  attest  to  the  relative  merits  of  the 
different  training  methods  for  that  task. 
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Adaptlve  training  researchers  have  hitherto  seemingly  failed  to 
discriminate  the  application  of  AT  to  control  tasks  that  can  be  learned 
under  FT  and  those  that  cannot.  As  the  choice  of  the  experimental  de- 
sign is  related  to  this  issue,  it  Is  Important  to  distinguish  the  two 
types  of  task.  Non-optlmal  experimental  designs  can  provide  important 
information,  as  some  in  AT  have  done  (e.g.  Gaines,  1967b;  Smith  et  £l_.  , 
1974)  but  the  information  is  devalued  to  the  extent  that  the  experi- 
mental design  departs  from  optimality.  Future  AT  research  could  bene- 
fit appreciably  from  greater  awareness  of  this  problem. 


ADDITIONAL  CONCERNS 


Dimensionality  of  Performance  Measures 

Experiment a tior  with  adaptive  techniques  has  been  dominated  by 
tracking  tasks.  The  most  popular  performance  measure  in  this 
task  is  RMS  tracking  error.  The  study  by  Gopher  et  al^.  (1975)  has 
called  attention  to  the  fact  that  composite  error  scores  on  a multi- 
dimensional or  high-order  tracking  task  may  not  reflect  a undimenslonal 
ability  factor  of  the  trainee.  In  this  study,  with  a two  dimensional 
pursuit  tracking  task,  the  vertical  axis  was  clearly  inferior  to  the 
horizontal  axis  as  a result  of  reduced  stimulus-response  compatibility 
on  that  axis.  Training  on  the  vertical  axis  progressed  at  a slower 
rate  even  after  each  axis  was  equated  for  difficulty.  These  findings 
suggest  that  the  employment  of  a composite  error  score,  such  as  vector 
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error,  or  average  RMS,  will  create  a sub-optimal  adaptive  procedure, 
because  the  rate  of  progress  will  be  too  slow  on  the  easy  axis  and  too 
fast  on  the  difficult  one.  In  more  general  terms  it  can  be  argued  that, 
for  multidimensional  tasks  where  dimensions  are  not  closely  related  and 
do  not  symetrlcally  covary  with  task  difficulty,  separate  performance 
measures  or  an  appropriate  weighting  function  should  be  developed  to 
assure  proper  adaptive  sequencing  on  each  dimension. 

Changing  the  Adaptive  Equation 

Adaptive  adjustments  are  assumed  to  continuously  reciprocate  the 
progress  of  learning.  Once  the  adaptive  variable  and  the  performance 
measure  are  defined  the  relationship  between  them  is  formulated  through 
the  adaptive  equation.  In  all  AT  studies  reviewed  in  this  paper  only 
one  adaptive  equation  was  employed  throughout  training.  Thus  it  was 
implicitly  assumed  that  the  relationships  between  AT  variables  remain 
constant  across  the  range  of  empirical  values  employed  during  training. 

This  is  a very  powerful  assumption  that  can  be  challenged. 

An  alternative  suggestion  is  that  an  equal  change  in  the  adaptive 
variable  will  have  a different  impact  on  task  difficulty  in  early  as 

j 

against  late  stages  of  training.  That  is,  the  relationship  between 
variables  in  the  adaptive  situation  may  change  during  the  course  of 
learning.  This  argument  is  supported  by  empirical  reports  of  S-shaped 
functions  relating  performance  increments  to  time-on-task  in  many  learn- 
ing tasks.  Fmployment  of  a single  unchanging  adaptive  equation  through- 
out training  may  introduce  a considerable  amount  of  rigidity  to  the 
adaptive  procress,  thus  detouring  it  from  its  optimum  course.  As  none  of  AT 
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studies  has  addressed  this  Issue,  its  possible  relevance  to  the  con- 
struction of  adaptive  schedules  cannot  be  evaluated.  It  may  be  advan- 
tageous to  construct  two  adaptive  loops  instead  of  one.  The  additional 
loop  would  function  as  a higher  level,  supervisory  loop  that  would  moni- 
tor the  general  progress  of  learning,  and  change  if  necessary,  the 
adaptive  equation  in  accordance  with  some  model  of  training.  The  pro- 
gramming and  management  of  such  double  loop  systems  is  well  within  the 
capabilities  of  the  current  computer  aided  instruction  (CAT)  technology. 
The  literature  Is  however,  notably  deficient  of  empirical  work  on  this 
type  of  system  and  further  research  is  recommended. 

The  Role  of  the  Instructor 

As  a final  note,  it  may  be  worthwhile  to  address  a misconception 
that  some  AT  researchers  seem  to  have  assimilated  from  naive  thinking 
about  other  instructional  uses  of  computers.  In  a first  rush  of 
enthusiasm  some  ardent  supporters  of  CAI  speculated  on  its  potential 
as  a complete  instructional  system  in  which  there  would  he  no  need  for 
human  Instructors.  CAI  is  often  attacked  on  the  basis  of  this  view, 
even  though  it  does  not  generally  hold  a respectable  position  among 
CAI  personnel.  It  does  however,  seem  to  pervade  the  thinking  of  AT 
researchers . 

During  the  AT  symposium  reported  by  McCrath  and  Harris  (1971), 
conferees  lauded  the  potential  for  automated  instruction  to  supersede 
the  human  Instructor.  The  expense  and  the  inability  of  human  instruc- 
tors to  react  optimally  in  all  situations  were  offered  as  reasons  for 
preferring  fully  automatt'd  training.  CAI  in  all  of  its  various  forms 
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should  be  placed  in  a more  balanced  perspective.  It  has  many  specific 
advantages,  but  none  of  them  Imply  that  the  human  should  be  designed 
out  of  the  instructional  process.  As  advancing  technology  is  making 
a completely  computerized  Instructional  system  progressively  more 
feasible  to  Implement,  a brief  defense  of  the  human  Instructor's  unique 
role  seems  timely. 

Role  modelling  Is  one  process  of  instruction  that  would  be  neglect- 
ed In  a fully  computerized  instructional  system.  Carkhuff  (1971)  has 
noted  that  identification  with  a suitable  role  model  substantially 
influences  behavior.  He  further  believes  that  modelling  is  the  most 
critical  source  of  learning  In  any  training  program  and  that  the  trainer 
Is  the  key  model.  Wliat  behavior  is  modified  by  the  modelling  process 
depends  on  its  availability,  its  functional  value,  and  the  attractive- 
ness of  the  model  (Secord  and  Backman,  1974).  Mere  exposure  to  the 
standards  of  others  Is  apparently  sufficient.  In  some  circumstances, 
to  modify  behavior  (Longstreth,  1968).  The  negative  consequences  of 
Identifying  with  machines,  alluded  to  by  Erlksen  (1963),  further  supports 
the  notion  that  CAI  can  be  detrimental  If  It  Is  permitted  to  dominate 
the  instructional  process. 

Optimally,  CAI  can  relieve  the  Instructor  of  specific  tasks  that 
are  tedious  or  difficult  so  that  he  may  devote  his  energy  to  the  uniquely 
human  aspects  of  Instruction,  but  It  cannot  provide  a total  educational 
experience.  Properly  validated  AT  procedures  could  substantially  improve 
training  efficiency,  but  should  be  considered  only  as  one  effective  train- 
ing aid  that  the  skillful  Instructor  can  use  In  conjunction  with  other 


available  training  aids. 


SUMMARY 


Although  adaptive  training  has  generally  been  accepted  within  engi- 
neering psychology  and  in  some  applied  settings,  there  are  few  data  to 
attest  to  its  advantages  for  teaching  vehicular  control  skills.  Re- 
search has  suffered  primarily  from  methodological  difficulties  and  from 
limited  conceptualization  of  the  many  facets  of  the  adaptive  paradigm. 

In  spite  of  our  generally  negative  view  of  much  AT  research,  other  motor 
skill  theory  and  research  and  a few  AT  experiments  indicate  the  the 
method  could  be  useful.  This  review  has  established  a conceptual  frame- 
work for  AT  to  guide  the  future  research  that  is  essential  to  test  and 
develop  the  method. 

In  particular,  the  choice  of  the  adaptive  variable  bears  on  the 
likely  success  of  the  training  manipulation.  However  the  choice  of 
adaptive  manipulations  generally  has  not  been  justified  and  often  seems 
to  have  been  a matter  of  convenience.  Researchers  rarely  have  dis- 
criminated between  difficulty  manipulations  in  general  and  those  that 
can  be  expected  to  facilitate  skill  acquistlon.  Response  manipulations 
have  been  popular  but  both  theory  and  data  suggest  that  they  will  dis- 
rupt rather  than  facilitate  skill  acquisition.  The  data  related  to 
perceptual  manipulations  are  only  slightly  more  encouraging  but  a 
theoretical  analysis  suggested  that  appropriate  perceptual  manipulations 
could  be  effective.  The  perceptual  manipulations  that  allow  practice 
with  task  segments  that  are  important  in  the  performance  iif  the  whole 
task  are  likely  to  be  most  effective.  The  data  related  to  feedback 
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varlables  were  promising.  Adaptations  that  initially  decreased  the 
difficulty  of  the  criterion  task  with  concurrent  off-target  augmented- 
feedback  that  guided  the  trainee  towards  the  correct  response  ii.-ive  been 
tested  successfully.  Contemporary  theories  and  substantial  skill 
acquisition  data  support  the  confidence  in  this  type  of  manipulation. 

Parameters  of  the  adaptive  logic  were  examined  for  their  influence 
on  skill  acquisition.  These  parameters  have  not  been  adequately  re- 
searched, although  some  observations  were  based  on  theory  and  limited 
data.  Transfer  theory  indicates  that  step  size  of  the  difficulty 
manipulation  can  be  too  large,  but  it  was  not  possible  to  estimate  the 
critical  size.  Stepping  rate  is  influenced  both  by  the  performance 
limits  that  determine  whether  a student  can  advance  in  the  adaptive 
schedule  and  the  performance  measurement  interval.  This  rate  sliould 
be  established  by  balancing  the  competing  demands  of  moving  the  trainee 
through  the  adaptive  schedule  as  economically  as  possible  and  of  allow- 
ing him  sufficient  time  to  learn  the  relevant  skills  at  each  of  the 
steps.  Although  there  are  no  compelling  principles  for  choosing  any 
specific  values,  performance  limits  that  approximate  those  that  are 
relevant  in  the  operational  situation  should  encourage  appropriate 
response  habits  and  strategies.  Optimum  performance  measurement 
Intervals  are  probably  specific  to  each  situation  and  at  this  stage 
at  least  will  have  to  be  determined  empirically. 

Criterion  task  difficulty  is  another  aspect  that  has  received 
sparse  attention  within  the  experimental  I 1 1 c'rat  lire . Two  ly)»es  of  l.isks 
were  identified  in  this  review;  those  that  could  be  learned  under  non- 
adaptlve  schedules  but  would  be  learned  more  efficiently  under  adaptive 
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schedules,  and  those  that  were  so  difficult  that  they  could  not  be  learn- 
ed under  anything  but  an  adaptive  schedule.  The  distinction  is  important 
because  it  demands  slightly  different  experimental  tests.  Tlie  test 
for  the  former  situation  should  be  designed  to  show  that  one  of  the 
schedules  leads  to  criterion  performance  more  quickly  than  the  other, 
while  the  test  of  the  latter  situation  should  allow  the  adaptive  schedule 
to  demonstrate  any  performance  advantage  it  may  encourage  after  extended 
training. 

In  conclusion,  a substantial  body  of  research  has  not  clearlv  demon- 
strated the  value  of  AT,  nor  has  It  clearly  indicated  that  the  technique 
is  ineffective.  To  reasonably  test  it  a far  more  comprehensive  program 
of  research  is  required.  Other  motor  skill  theory  and  researcti  suggest 
that  such  a research  program  could  demonstrate  benefits  for  AT.  The 
research  approach  outlined  in  this  review  could  establish  a worthwhile 
data  base  from  which  the  validity  of  AT  as  a training  nu'thod  could  be 
judged . 
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